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PREFACE 


This  Note  describes  the  derivation  of  a  set  of  equations  suitable 
for  estimating  the  acquisition  costs  of  aircraft  airframes  in  the 
absence  of  detailed  design  and  manufacturing  information.  In  broad 
form,  the  research  updates  and  extends  the  equation  set  published  in  J. 
P.  Large  et  al.,  Parametric  Equations  for  Estimating  Aircraft  Airframe 
Costs,  The  RAND  Corporation,  R-1693-1-PA&E,  February  1976,  and  used  in 
the  RAND  aircraft  cost  model,  DAPCA:  H.  E.  Boren,  Jr.,  A  Computer  Model 
for  Estimat ing  Development  and  Procurement  Costs  of  Aircraft 
(DAPCA-III ) ,  The  RAND  Corporation,  R-1854-PR,  March  1976. 

The  present  effort  was  undertaken  in  the  context  of  a  larger 
overall  study  whose  objectives  included:  (a)  an  analysis  of  the  utility 
of  dividing  the  full  estimating  sample  into  subsamples  representing 
major  differences  in  aircraft  type  (attack,  fighter,  and 
bomber/transport);  and  (b)  an  examination  of  the  explanatory  power  of 
variables  describing  program  structure  and  airframe  construction 
techniques.  Additionally,  for  the  fighter  subsample  only,  the  study 
investigated  the  possible  benefits  of  incorporating  an  objective 
technology  measure  into  the  equations.  A  detailed  description  of  the 
overall  study,  including  the  research  approach,  evaluation  criteria,  and 
database  may  be  found  in  R.  W.  Hess  and  H.  P.  Romanoff,  Aircraft 
Airframe  Cost  Estimating  Relationships:  Study  Approach  and  Conclusions , 
The  RAND  Corporation,  R-3255-AF,  December  1987. 

To  address  the  issue  of  sample  homogeneity,  each  of  the  subsamples, 
as  well  as  the  full  sample,  had  to  be  investigated  in  detail  with  the 
ultimate  goal  of  developing  representative  sets  of  cost  estimating 
relationships  (CERs)  for  each.  The  purpose  of  this  Note  is,  therefore, 

►  to  document  the  analysis  of  the  full  estimating  sample.  Study  results 

concerning  the  individual  subsamples  are  available  in  a  series  of 
companion  Notes: 


* 
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Aircraft  Airframe  Cost  Estimating  Relationships:  Fighters , 

N-2283/2-AF,  December  1987. 

Aircraft  Airframe  Cost  Estimating  Relationships :  Bombers  end  Transports , 

N-2283/3-AF,  December  1987. 

Aircraft  Airframe  Cost  Estimating  Relationships :  Attack  Aircraft, 

N-2283/4-AF ,  December  1987. 

This  research  was  undertaken  as  part  of  the  Project  AIR  FORCE  study 
entitled  "Cost  Analysis  Methods  for  Air  Force  Systems,"  which  has  been 
superseded  by  "Air  Force  Resource  and  Financial  Management  Issues  for 
the  1980s"  in  the  Resource  Management  Program. 

While  this  report  was  in  preparation,  Lieutenant  Colonel  H.  P. 

Romanoff,  USAF,  was  on  duty  in  the  System  Sciences  Department  of  The 
RAND  Corporation.  At  present,  he  is  with  the  Directorate  of  Advanced 
Programs  in  the  Office  of  the  Assistant  Secretary  of  the  Air  Force  for 
Acquisition. 


SUMMARY 


This  Note  presents  generalized  equations  for  estimating  the 
development  and  production  costs  of  aircraft  airframes.  It  provides 
separate  estimating  relationships  for  engineering,  tooling, 
manufacturing  labor,  manufacturing  material,  development  support,  flight 
test,  and  quality  control  as  well  as  for  total  program  cost.  The 
estimating  relationships,  expressed  in  the  form  of  exponential 
equations,  were  derived  by  multiple  least-squares  regression  analysis. 
They  were  derived  from  a  database  consisting  of  34  military  aircraft 
with  first  flight  dates  ranging  from  1948  to  1978.  The  aircraft 
technical  data  were  obtained  for  the  most  part  from  either  original 
engineering  documents  such  as  manufacturer's  performance  substantiation 
reports  or  from  official  Air  Force  and  Navy  documents.  The  cost  data 
were  obtained  from  the  airframe  manufacturers  either  directly  from  their 
records  or  indirectly  through  standard  Department  of  Defense  reports 
such  as  the  Contractor  Cost  Data  Reporting  System. 

For  each  airframe  cost  category  there  are  generally  several 
potentially  useful  estimating  equations.  Nevertheless,  a  single  set  of 
equations  has  been  selected  as  being,  in  our  judgment,  the  most 
representative  and  applicable  to  the  widest  range  of  estimating 
situations.  The  selection  rationale,  as  well  as  the  alternative 
equations  and  supporting  data,  are  presented  in  this  Note  so  that 
interested  readers  may  make  their  own  judgments. 

The  equation  set  selected  as  most  representative  uses  empty  weight 
and  speed  as  the  basic  size/performance  variable  combination.  It  is 
based  on  a  subsample  of  the  full  estimating  sample  consisting  of  13  post- 
1960  aircraft.  We  concluded  that  the  more  limited  post-1960  experience 
would  be  a  better  guide  to  the  future  than  the  cumulative  experience 
dating  back  to  1948. 

Our  attempts  to  incorporate  construction  and  program 
characteristics  were  not  successful.  Although  variables  characterizing 
the  equipment  placed  within  tne  airframe  structure  and  a  contractor's 
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relevant  experience  were  frequently  found  to  be  statistically 
significant,  they  did  not,  as  a  rule,  result  in  any  substantial 
improvement  in  the  quality  of  the  equations.  In  most  cases,  the 
equations  incorporating  such  variables  did  not  produce  results  that  we 
viewed  as  credible.  Moreover,  even  in  those  few  instances  where  the 
equations  did  produce  credible  results,  the  reduction  in  the  standard 
error  of  estimate  was  never  more  than  two  or  three  percentage  points. 

The  statistical  quality  of  the  set  of  airframe  cost  estimating 
relationships  (CERs)  presented  here  is  not  much  different  from  that  of 
the  last  set  of  RAND-developed  airframe  CERs  (DAPCA  III).1  However, 
there  have  been  some  changes  in  the  equation  coefficients  with  the 
result  that  the  current  set  tends  to  produce  higher  estimates  than  does 
the  DAPCA  III  set. 

The  ultimate  test  will  of  course  be  the  set's  ability  to  estimate 
the  cost  of  future  aircraft.  Unfortunately  (from  an  estimating  point  of 
view),  airframes  are  changing  dramatically  with  respect  to  materials 
(e.g.,  more  extensive  use  of  composites),  design  concepts  (e.g., 
cOiicejj^o  increase  tud  efficiency  and  to  reduce  radar  cross-section), 
and  manufacturing  techniques  (e.g.,  use  or  computers  and  robots).  We 
believe  that  the  material  and  design  changes  will  act  to  increase  unit 
costs  but  we  are  uncertain  about  the  net  impact  of  capital  equipment 
changes.  In  any  case,  it  is  highly  unlikely  that  anv  the  ^ouation 
sets  presented  in  this  document  will  overestimate  the  costs  of  future 
aircraft . 

lThe  last  set  of  airframe  CERs  is  documented  in  J.  P.  Large  et  al., 
Parametric  Equations  for  Estimating  Aircraft  Airframe  Costs, 

R- 1 693- l-PA&E ,  February  1976,  and  used  in  the  most  lecent  version  of  the 
RAND  aircraft  cost  model,  commonly  known  as  DAPCA:  H.  E.  Boren,  Jr.,  A 
Computer  Model  for  Estimating  Development  and  Procurement  Costs  of 
Aircraft  (DAPCA- I II ) ,  R-1854-PR,  March  1976. 
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AVAUW 

BLBOX 

CA 

CARGODV 

CARRDV 

CLIMB 

DS 

ENGDV 

ENGLOC 


ENGRioo 

EXPDV 

EW 

EWAUW 


FFD 


FT 

LABR 


100 


MATL 


100 


Airframe  unit  weight  (lb) 

Ratio  of  avionics  weight  to  airframe  unit  weight 
Number  of  black  boxes 
Cumulative  average 

Cargo  aircraft  designator  (1  =  no;  2  =  yes) 

Carrier  capability  designator  (1  =  no;  2  =  yes) 

Rate  of  climb  (ft/min) 

Development  support  cost  (thousands  of  1977  dollars) 

New  engine  designator  (1  =  no;  2  =  yes) 

Engine  location  designator  (1  =  embedded  in  fuselage;  2  = 
in  nacelles  under  wing) 

Cumulative  engineering  hours  for  100  aircraft  (thousands) 
Contractor  experience  designator  (1  =  yes;  2  =  no) 

Empty  weight  (lb) 

Ratio  of  empty  weight  less  airframe  unit  weight  to 
airframe  unit  weight 

First  flight  date  (measured  in  months  since  January  1, 
1940) . 

Flight  test  cost  (thousands  of  1977  dollars) 

Cumulative  manufacturing  labor  hours  for  100  aircraft 
(thousands) 

Cumulative  manufacturing  material  costs  for  100  aircraft 
(thousands  of  1977  dollars) 


PRGDV 


Program  type  designator  (1  =  concurrent;  2  =  prototype) 
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USELD 

ULTLD 
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Cumulative  total  program  cost  for  100  aircraft  (thousands 
of  1977  dollars) 

Quantity 

Cumulative  quality  control  hours  for  100  aircraft 
(thousands) 

Maximum  speed  (knots) 

Speed  class  (1  =  <Mach  .95;  2  =  Mach  .95  to  Mach  1.94;  3 
=  Mach  1.95  to  Mach  2.5;  4  =  >Mach  2.5) 

Number  of  flight  test  aircraft 
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Ratio  of  wing  area  to  wetted  area 


EVALUATION  CRITERIA  NOTATION 


Notation 


Explanation 


EQ  SIG:  F-TEST 

I 

EXP  MAG:  variable  mnemonic 

EXP  SIGN:  variable  mnemonic 


10:  aircraft  identification 


Equation  as  a  whole  is  not 
significant  at  5  percent  level  (based 
on  F-statistic) 

Question  exists  regarding  magnitude 
of  variable  exponent  (reasonableness) 

Sign  of  variable  exponent  does  not 
agree  with  a  priori  notions 

F-statistic 

Based  on  "Cook's  Distance,"  aircraft 
indicated  to  be  influential 
observation 


LDIFF:  variable  mnemonic 

MCOL:  r (variable)  >  .7,  .8,  or  .9 

N 

R2 

RP:  CUR:  OVER/UNDER 

RP:  DIST 

SEE 


Limited  differentiation  in  dummy 
variable;  coefficient  determined  by 
single  observation  or  portion  of 
dummy  variable  range  not  included  in 
a  subsample 

Indicates  degree  of  intercorrelation 
of  specified  variable  with  other 
equation  variables  (only  provided 
when  threshold  of  .7  is  exceeded) 

Number  of  observations 

Coefficient  of  determination 

Residual  pattern  indicates  that  the 
most  recently  developed  aircraft  in 
the  sample  are  over-  or 
underestimated 

Residual  pattern  indicates  that  the 
terror  is  not  normally  distributed 
with  zero  mean  and  constant  variance 

Standard  error  of  estimate 


VAR  SIG:  variable  mnemonic  Variable  is  not  significant  at  the  5 

percent  level  (t-statistic) 1 


lVariable  significance  is  provided  in  parentheses  beneath  each 
variable . 


I.  INTRODUCTION 


Parametric  models  for  estimating  aircraft  airframe  acquisition 
costs  have  been  used  extensively  in  advanced  planning  studies  and 
contractor  proposal  validation.  These  models  are  designed  to  be  used 
when  little  is  known  about  an  aircraft  design  or  when  a  readily  applied 
validity  and  consistency  check  of  detailed  cost  estimates1  is  necessary. 
They  require  inputs  that:  (a)  will  provide  relatively  accurate  results; 
(b)  are  logically  related  to  cost;  and  (c)  can  easily  be  projected 
before  actual  design  and  development.  The  intent  is  to  generate 
estimates  that  include  the  cost  of  program  delays,  engineering  changes, 
data  requirements,  and  inefficiencies  of  all  kinds  that  occur  in  a 
normal  program. 

Since  1966,  RAND  has  developed  three  parametric  airframe  cost 
models.2  These  models  have  been  characterized  by:  (a)  easily 
obtainable  size  and  performance  inputs  (weight  and  speed);  (b)  the 
estimation  of  costs  at  the  total  airframe  level;  and  (c)  the  use  of 
heterogeneous  aircraft  samples.  They  have  normally  been  updated  when  a 
sufficient  number  of  additional  aircraft  data  points  have  become 
available  to  suggest  possible  changes  in  the  equations.  Such  is  the 
case  with  regards  to  this  present  effort:  The  A-10,  F-15,  F-16,  F-18, 
F-101,  and  S-3  have  been  added  to  the  estimating  sample.3 

In  addition  to  expanding  the  database,  we  also  examined:  (a)  the 
utility  of  dividing  the  estimating  sample  into  subsamples  representing 
major  differences  in  aircraft  type  (attack,  fighter,  bomber/transport); 
(b)  the  explanatory  power  of  variables  describing  program  structure  and 

Examples  of  this  latter  application  include  the  Independent  Cost 
Analysis  (ICA)  prepared  as  part  of  the  Defense  Systems  Acquisition 
Review  Council  (DSARC)  process,  and  government  analyses  of  contractor 
cost  proposals  during  source  selections. 

2 See  Refs.  1,  2,  and  3. 

Additional ly ,  the  F-86,  F-89,  and  F3D,  which  were  dropped  from  the 
DAPCA-III  estimating  sample,  were  reintroduced. 
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airframe  construction  techniques;  and  (c)  the  possible  benefits  of 
incorporating  an  objective  technology  measure  into  the  fighter  sample 
equations.  To  address  the  issue  of  sample  homogeneity,  each  subsample, 
as  well  as  the  full  sample,  had  to  be  investigated  in  detail  with  the 
ultimate  goal  of  developing  representative  sets1*  of  cost  estimating 
relationships  (CERs)  for  each.  The  purpose  of  this  Note  is,  therefore, 
to  document  the  selection  of  a  representative  set  of  CERs  for  the  full 
sample . 

A  detailed  description  of  the  overall  study,  including  the  research 
approach,  evaluation  criteria,  and  database,  may  be  found  in  the 
companion  report,  R-3255-AF. 

APPROACH  AND  PRINCIPAL  RESULTS 

Our  analysis  produced  a  number  of  potentially  useful  equations  for 
each  of  the  airframe  cost  elements.  In  fact,  this  Note  contains  each  of 
the  213  equations  that  met  our  initial  screening  criteria  relative  to 
variable  significance  (discussed  in  Sec.  II).  Additionally,  data  plots 
have  been  included  for  each  cost  element.  Presenting  such  a  large 
number  of  equations  and  supporting  data  serves  two  purposes.  First,  the 
information  contained  in  the  equations  and  plots  can  provide  an  improved 
understanding  of  the  factors  that  influence  airframe  costs.  Thus,  the 
estimator  will  have  a  more  complete  context  in  which  to  judge  the 
applicability  of  specific  estimating  equations.  Second,  we  are  offering 
the  user  alternatives  for  each  cost  element  that  may  be  better  suited  in 
a  particular  case  than  any  single  equation  that  we  might  have  selected 
if  we  had  chosen  to  document  just  one.  This  is  important  because,  in 
general,  the  study  did  not  produce  one  equation  for  each  cost  element 
that  is  clearly  preferred  over  all  others.  The  user  should  review  all 
of  the  results  before  selecting  the  equations  to  be  used  in  a  particular 
situation. 


"A  set  encompasses  the  following  cost  elements:  engineering, 
tooling,  manufacturing  labor,  manufacturing  material,  development 
support,  flight  test,  and  quality  control. 


The  basic  estimating  sample  used  in  our  analysis  consists  of  32 
"new  design"  aircraft  (seven  attack  aircraft,  eight  bombers  and 
transports,  15  fighters,  and  two  trainers)  with  first  flight  dates 
spanning  the  years  1948  to  1974.  All  cost  data  were  obtained  from  an 
unpublished  RAND  study,  which  compiled  cost  and  manhour  data  on  major 
U.S.  aircraft  development  and  production  programs  from  the  late  1940s  to 
1977.  All  technical  data  were  obtained  either  from  original  engineering 
documents  or  from  official  Air  Force  and  Navy  aircraft  characteristics 
summaries . 

As  a  result  of  our  analysis  of  the  basic  32  aircraft  estimating 
sample,  we  identified  what  we  felt  to  be  the  best  possible  equation  set. 
uiiioi Lunately ,  the  engineering,  manufacturing  material,  development 
support,  flight  test,  and  total  program  cost  estimating  relationships  in 
that  set  tended  to  underestimate  the  costs  of  the  most  recent  sample 
aircraft.  Consequently,  questions  were  raised  concerning  whether  the 
older  aircraft  in  the  sample  were  representative  of  aircraft  of  the 
future.  As  a  result,  additional  analysis  of  11  post-1960  aircraft  was 
undertaken.  On  the  basis  of  this  additional  analysis,  we  concluded  that 
the  more  limited  post-1960  experience  was  a  better  guide  to  the  future 
than  the  cumulative  experience  dating  back  to  1948. 

After  completion  of  the  preceding  analyses  but  before  publication 
of  this  Note,  however,  cost  data  for  the  F-16  and  F-18  became  available. 
Consequently,  a  brief  follow-on  analysis  was  undertaken  to  determine 
whether  inclusion  of  the  F-16  and  F-18  in  the  estimating  sample  would 
dictate  modification  of  the  previously  decided  upon  set  of  CERs . 5  We 
concluded  that  from  a  statistical  standpoint  their  inclusion  made  very 
little  difference.  However,  it  was  felt  that  most  users  would  prefer  to 
use  an  equation  set  that  was  based  on  the  most  up-to-date  information. 
Therefore,  the  equation  set  that  we  have  chosen  to  recommend,  and  which 
is  presented  in  Table  1,  is  based  on  an  expanded  post- 1960  estimating 
sample  of  13  aircraft  (four  attack  aircraft,  two  transports,  six 

sThe  initial  detailed  analysis  was  not  repeated  because  a  great 
deal  of  effort  would  have  been  required  and  we  simply  did  not  feel  it 
was  warranted. 
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Table  1 

RECOMMENDED  SET  OF  AIRFRAME  CERs 
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fighters,  and  one  trainer).  The  ranges  of  the  Variables  used  in  the  set 
are  as  follows: 


Characteristic 


Database  Range 


Empty  weight  (lb) 

Maximum  speed  (kn) 

Number  of  flight  test  aircraft 


9,753  -  320,085 
389  -  1,250+ 

10  -  33 


The  estimating  relationships  in  the  recommended  aquation  set  vary 
significantly  in  statistical  quality.  Four  of  the  CERs  have  standard 
errors  of  estimate  of  about  0.30  whereas  the  other  three  CERs  have 
standard  errors  of  estimate  of  about  0.50  or  greater.  None  of  the 
equations  meets  our  standard  error  of  estimate  goal  of  0.18. 6  On  the 
other  hand,  the  lowest  standard  errors  of  estimate  in  the  set  are 
associated  with  cost  elements  (tooling,  labor,  and  material),  which 
typically  account  for  66  percent  of  total  program  cost  (at  a  quantity  of 
100;  at  a  quantity  of  200,  these  elements  account  for  71  percent  of 
total  program  cost).  Finally,  we  note  that  there  is  some  tendency  for 
the  engineering,  development  support,  and  total  program  cost  equations 
to  underestimate  the  costs  of  the  most  recent  sample  aircraft. 

To  adjust  the  quantity-dependent  estimating  relationships  to 
quantities  other  than  100, 7  the  following  slopes  are  recommended: 

Cumulative  Total  Cumulative  Total 
Slope  (%)  Exponent 


Engineering 

112 

.  163 

Tooling 

120 

.263 

Manufacturing  labor 

156 

.641 

Manufacturing  material 

174 

.799 

Quality  control 

156 

.641 

Total  program  cost 

132 

.401 

6  A  logarithmic  standard  error  of  estimate  of  0.18  is  equivalent  to 
-16  percent,  +20  percent  for  the  corresponding  hour  or  dollar  form  of 
the  equation. 

7Cost (Q  )  =  Cost ( 100)  *  (Q  /100)eXp°nent 
new  new 


L 


The  manufacturing  material,  development  support,  flight  test,  and 
total  program  cost  categories  are  all  estimated  directly  in  1977 
dollars.  To  convert  the  remaining  cost  categories,  which  are  estimated 
in  manhours,  to  1977  dollars,  the  following  fully-burdened  hourly  labor 
rates  are  suggested: 


Engineering 

27 

.  50 

Tooling 

25. 

.50 

Manufacturing  labor 

23. 

.50 

Quality  control 

24, 

.00 

For  estimates  in  1986  dollars,  the  following  hourly  labor  rates  and 
adjustment  factors  are  suggested: 


Engineering  59.10 
Tooling  60.70 
Manufacturing  labor  50.10 
Quality  control  55.40 
Manufacturing  material  (index)  1.94 
Development  support  (index)  1.94 
Flight  test  (index)  1.94 
Total  program  cost  (index)  2.13 


NOTE  ORGANIZATION 

Section  II  provides  brief  descriptions  of  the  database  and 
statistical  analysis  methods.  Section  III  provides  an  initial  overview 
of  the  individual  cost  element  analyses  that  follow.  Sections  IV 
through  XI  provide,  by  cost  element,  data  plots,  estimating 
relationships  meeting  our  initial  screening  criterion,  and  the  rationale 
for  selection  of  "representative"  equations.8  Section  XII  explains  the 
selection  of  the  recommended  equation  set.  Section  XIII  details  the 
incorporation  of  the  F-16  and  F-18  data.  Finally,  Sec.  XIV  summarizes 
the  main  findings  of  the  analysis. 

*As  stated  above,  the  detailed  analysis  was  not  repeated  when  the 
F-16/F-18  data  were  obtained.  Therefore,  Secs.  I I -X I I  are  based  on  the 
32  aircraft  estimating  sample  that  does  not  include  the  two  most  recent 
fighters . 
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Three  appendixes  contain  miscellaneous  supporting  information. 
Appendix  A  describes  a  way  to  address  mission  designation  that  does  not 
require  separate  samples.  Appendix  B  contains  two  correlation  matrices: 
one  of  potential  explanatory  variables  with  the  dependent  cost  variables 
and  one  of  potential  explanatory  variables  with  other  potential 
explanatory  variables. 
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II.  DATABASE  AND  ANALYTICAL  APPROACH 


As  stated  above,  a  detailed  description  of  the  research  approach, 
evaluation  criteria,  and  database  for  this  study  may  be  found  in 
R-3255-AF.  However,  to  give  this  Note  a  degree  of  self-sufficiency,  a 
synopsis  of  the  database  and  analytical  approach  is  presented  before 
the  reporting  of  results. 


ESTIMATING  SAMPLE 

The  "basic"  all-mission  type  estimating  sample  consists  of  the 
following  32  "new-design"  aircraft.1 


Model 

First  Flight 

Date 

Model 

First  Flight 
Date2 

A-3 

1953 

F4D 

1954 

A-4 

1954 

F-4 

1961 

A-5 

1958 

F- 14 

1970 

A-6 

1960 

F-15 

1972 

A-7 

1965 

F-86 

1948 

A- 10 

1974 

F-89 

1950 

B-52 

1954 

F-100 

1953 

B-58 

1957 

F- 101 

1954 

B/RB-66 

1954 

F- 102 

1955 

C-5 

1968 

F-104 

1956 

C- 130 

1955 

F-105 

1956 

C-133 

1956 

F- 106 

1956 

KC- 135 

1957 

F-lll 

1967 

C- 141 

1963 

S-3 

1972 

F3D 

1950 

T-38 

1959 

F3H 

1955 

T-39 

1960 

;The  classification  of  an  iarcraft  as  new  or  derivative  is  not  an 
entirely  objective  procedure.  For  example,  although  the  F-102A  program 
laid  the  groundwork  for  the  F-106A,  the  F-106A  is  classified  as  a  new 
design  in  the  database  because,  in  contrast  to  the  F-102A,  it  had  a  new 
engine,  relocated  air  intakes,  variable-geometry  air  inlets,  a  modified 
vertical  stabilizer,  and  markedly  better  performance. 

2The  first  flight  dates  presented  in  this  report  relfect  the  first 
flight  date  of  the  version  that  was  most  representative  of  the  aircrft 
that  was  to  become  operational.  These  dates  thus  reflect  the  first 
flight  date  of  the  developmental  aircraft,  not  earlier  experimental  or 
prototype  aircrft.  Thus,  although  the  F-4A  aircraft  first  flew  in  May 
1958,  the  first  flight  date  of  the  F-4B  aircraft  is  presented. 


9 


DEPENDENT  VARIABLES 

Costs  have  been  dealt  with  at  both  the  total  program  level*  and  at 
the  major  cost  element  level  (engineering,  tooling,  manufacturing  labor, 
manufacturing  material,  development  support,  flight  test,  and  quality 
control  j.1*  The  relative  importance  of  the  various  cost  elements  (in 
terms  of  percent  of  total  program  cost)  is  shown  below  for  four 
alternative  production  quantities: 


Quantity 


Cost  Element 

25 

50 

100 

200 

Engineering 

24 

22 

18 

15 

Tooling 

19 

18 

16 

13 

Manufacturing  labor 

25 

30 

35 

40 

Manufacturing  material 

10 

12 

16 

20 

Development  support 

9 

7 

5 

4 

Flight  test 

10 

8 

6 

4 

Quality  control 

3 

3 

4 

4 

100 

100 

100 

100 

Clearly,  other  things  being  equal,  one  would  want  the  estimating  ] 

relationships  derived  for  the  two  manufacturing  categories  to  be  the  •. 

most  accurate  because  of  the  relatively  large  contribution  of  these 
elements  to  the  program  cost. 

Engineering,  tooling,  manufacturing  labor,  and  quality  control  are 
estimated  in  terms  of  manhours  rather  than  dollars  for  two  reasons:  (a)  •, 

it  avoids  the  need  to  make  adjustments  for  annual  price  changes,  and  (b) 
it  permits  comparison  of  real  differences  in  labor  requirements.5 

*Total  program  costs  are  "normalized"  values  and  not  the  actual 
reported  dollar  amounts.  They  are  normalized  in  the  sense  that  the 
dollar  amounts  for  engineering,  tooling,  manufacturing  labor,  and 
quality  control  have  been  determined  by  applying  fully  burdened, 
industry-average  labor  rates  to  the  hours  reported  for  each  category. 

“Cost  element  definitions  are  provided  in  Appendix  A  of  R-3255-AF. 

5The  major  limitation  of  the  manhour  approach  is  that  it  does  not 
account  for  differences  in  overhead  rates.  Consequently,  differences  in 
such  things  as  capital/ labor  ratios  cannot  be  addressed. 
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Manufacturing  material,  development  support,  and  flight  test  do  not  lend 
themselves  to  this  approach  and  were  therefore  estimated  in  terms  of 
dollars  (in  this  case,  constant  1977  dollars). 

POTENTIAL  EXPLANATORY  VARIABLES 

To  have  been  included  among  the  characteristics  that  were 
considered  for  inclusion  in  the  CERs,  the  following  requirements  must 
have  been  fulfilled: 

1.  The  variable  had  to  be  logically  related  to  cost:  that  is,  a 
rationale  had  to  be  constructed  explaining  why  cost  should  be 
influenced  by  the  variable; 

2.  The  variable  had  to  be  one  that  was  "readily  available"  in  the 
early  stages  of  aircraft  conceptualization;  and 

3.  The  variable  had  to  have  an  available  historical  record. 


During  the  formulation  stage  of  this  study,  20  aircraft 
characteristics  were  identified  as  potential  explanatory  variables  for 
the  total  sample  CERs.  Values  for  these  characteristics,  which  are 
grouped  into  four  general  categories  (size,  performance,  construction, 
and  program)  are  provided  in  Table  2.  Using  information  in  this  table, 
the  following  observations  can  be  made: 

1.  Minimum  and  maximum  values  for  airframe  unit  weight,  empty 
weight,  wetted  area,  speed,  and  climb  rate  each  span  a  range  of 
over  an  order  of  magnitude. 

2.  Several  of  the  continuous  variables  have  maximum  values  that 
fall  substantially  beyond  two  standard  deviations:  airframe 
unit  weight,  empty  weight,  wetted  area,  speed,  climb  rate, 
number  of  black  boxes,  number  of  test  aircraft,  and  maximum 
tooling  capability. 

3.  Using  any  of  the  three  size  measures,  the  C-5  is  approximately 
twice  as  large  as  the  next  largest  aircraft  in  the  sample. 

4.  The  sample  does  not  include  any  aircraft  that  are  both 
relatively  large  and  relatively  fast  (such  as  the  B-l  would 
have  been*-airframe  unit  weight  of  approximately  150,000  lb  and 
speed  of  Mach  2).  This  point  is  illustrated  in  Fig.  1. 
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AIRCRAFT  CHARACTERISTIC  VALUES 


Maximum  speed  (kn) 


A  summary  breakdown  (Table  3)  indicates  how  the  characteristics 
vary  with  mission  type.  As  one  would  expect,  the  fighter  and  attack 
aircraft  are  roughly  comparable  in  size  with  the  bombers  and  transports 
much  larger.  In  terms  of  combat  engagement  characteristics  (speed, 
climb  rate,  and  design  ultimate  load  factor),  the  ordering  (from  low  to 
high)  is  bomber/transport,  attack,  and  fighter,  whereas  for  payload 
capability  (useful  load  fraction)  the  order  is  reversed.  In  terms  of 
the  two  packaging  ratios  (ratio  of  EW-AUW  to  AUW  and  ratio  of  avionics 
weight  to  AUW),  the  attack  and  fighter  aircraft  are  essentially 
equivalent  and  the  bomber/ transport  aircraft  are  significantly  lower. 

On  the  other  hand,  the  bomber/transports  have,  on  average,  substantially 
more  black  boxes  than  do  either  the  attack  or  fighter  aircraft. 

Finally,  we  note  that,  on  average,  planned  production  rates  for  attack 
and  fighter  aircraft  are  roughly  twice  those  of  bomber/transport 
aircraft . 

There  are,  of  course,  differences  between  the  aircraft  that  are  not 
accounted  for  in  Tables  2  or  3.  Some  of  the  differences  relate  to  the 
way  an  aircraft  is  constructed  (materials,  manufacturing  technology), 
others  to  the  way  the  program  is  managed.  In  any  case,  it  is  difficult 
to  find  an  aircraft  without  at  least  one  unique  aspect.  Therefore,  the 
following  list  is  intended  only  to  be  indicative  of  the  types  of 
differences  that  are  difficult  to  account  for  in  a  generalized  parametric 
model . 

1.  The  C-130  and  C-133  are  prop  aircraft  whereas  all  other  sample 
aircraft  use  turbojet  or  turbofan  engines. 

2.  The  KC-135  was  designed  and  produced  more  or  less  concurrently 
with  the  commercial  707  model. 

3.  The  B/RB-66  was  produced  concurrently  with  the  A-3,  the 
aircraft  from  which  it  evolved. 

4.  The  F-102  did  not  meet  its  speed  performance  specifications 
until  after  a  major  redesign. 
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5.  The  F-106  and  A-7  were  outgrowths  of  the  F-102  and  F-8 
programs,  respectively. 

6.  The  F-lll  was  the  first  aircraft  for  which  common  Air 
Force/Navy  usage  was  made  a  requirement  at  inception. 

7.  The  B-58's  use  of  honeycombed  skin  panels  represented  a  major 
state-of-the-art  advance. 

8.  The  C-5  program  used  the  acquisition  concepts  of  total  package 
procurement  and  concurrent  development  and  production. 

9.  The  A- 10  program  used  the  acquisition  concepts  of  competitive 
prototyping  and  design-to-cost . 

A  priori  notions  regarding  the  effect  of  an  increase  in  the  value 
of  an  explanatory  variable  on  each  of  the  cost  elements  is  indicated  in 
Table  4.  A  plus  indicates  a  positive  effect,  a  minus  a  negative  effect. 
An  effect  thought  to  be  negligible  is  indicated  by  a  blank,  and  an 
uncertain  effect  is  indicated  by  a  question  mark. 

APPROACH 

Potential  explanatory  variables  have  been  divided  into  four  general 
categories--size ,  performance,  construction,  and  program  (see  Table  4). 
Ideally,  an  airframe  cost  estimating  relationship  would  incorporate  at 
least  one  variable  from  each  category.  But  from  a  practical  standpoint, 
concern  about  col linearity  among  the  explanatory  variables  in  two  of  the 
categories  (size  and  performance)  led  to  a  limit  of  one  on  the  number  of 
explanatory  variables  that  could  be  incorporated  into  an  estimating 
relationship  from  any  single  category.  Thus,  there  could  be  as  many  as 
four  variables  per  equation  but  no  more  than  four. 

With  respect  to  the  specific  combinations  of  variable  categories 
examined,  it  is  our  understanding  that  all  airframe  manufacturers  use 
some  measure  of  size  (usually  weight)  as  their  basic  scaling  dimension 
in  developing  cost  estimates  (although  other  factors  frequently  do  enter 
inj.  Consequently,  it  seemed  reasonable  for  a  similar  assumption  to  be 
made  on  our  part--a  size  variable  must  appear  in  all  equations  (except 
for  flight  test  in  which  case  the  number  of  test  aircraft  was  the 
mandatory  variable).  Therefore,  the  specific  variable  combinations  that 
were  considered  for  the  full  estimating  sample  are  as  follows: 


PRIORI  NOTIONS  REGARDING  EFFECT  OF  INCREASE  IN  EXPLANATORY  VARIABLE  ON  COST  ELEMENT 
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Size 

Size/performance  4 

Size/per formance/const ruction 

Size/performance/program 

Size/per formance/const ruction/ program 


An  additional  complication  arose  from  the  fact  that  we  were  not 
developing  a  single  CER  but  rather  a  set  of  CERs.  Normally,  the 
development  of  a  representative  set  of  CERs  would  require  the  selection 
of  the  "best"  equation  for  each  cost  element.  However,  past  experience 
indicates  that  in  so  doing  the  resulting  equation  set  would  contain 
different  size  and  performance  variables  (e.g.,  airframe  unit 
weight/speed  and  empty  weight/climb  rate).  Such  a  result  would  put  the 
analyst  in  the  unenviable  position  of  trying  to  explain  why  a  given 
size/performance  variable  combination  predicts  cost  more  accurately  for 
one  cost  element  whereas  another  size/performance  variable  combination 
predicts  cost  more  accurately  for  another  cost  element.  Furthermore, 
because  of  variable  interaction  (e.g.,  such  as  between  speed  and  rate  of 
climb),  the  user's  input  task  would  become  more  difficult.  On  the  other 
hand,  t..ere  is  nothing  to  say  that  such  mixing  of  the  size  and 
performance  variables  could  not  in  fact  be  the  preferred  solution. 
Consequently,  two  types  of  equation  sets  have  been  developed:  one  that 
maintains  the  integrity  of  the  set  size  and  performance  variables  and 
one  that  uses  the  "best"  equation  for  each  cost  element  regardless  of 
the  size  or  performance  'variables. 

The  first  step  in  developing  a  representative  set  of  CERs  was  to 
identify  all  potentially  useful  estimating  relationships  for  each  cost 
element  resulting  from  the  variable  combinations  listed  above.  For  this 
first  step,  "potentially  useful"  included  only  those  estimating 
relationships  in  which  all  equation  variables  were  significant  at  the  5 
percent  level.  For  the  one-  and  two-variable  combinations,  all  possible 
equations  were  examined.  An  initial  inspection  was  next  undertaken  to 
identify  the  "most  promising"  size/performance  combinations.  Then,  for 
the  three-variable  combinations,  each  construction  and  program  variable 
was  examined  in  conjunction  with  the  "most  promising"  size/performance 


A 
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variable  combinations.  For  the  four  variable  combinations,  the 
regressions  that  were  run  were  based  on  intuition  developed  in  the 
preceding  analyses  of  the  two-  and  three-variable  combinations. 

Each  equation  satisfying  the  initial  screening  criterion  (5  percent 
variable  significance)  was  then  scrutinized  in  accordance  with  a  set  of 
evaluation  criteria  dealing  with  statistical  quality  and  reasonableness 
of  results  (these  are  described  in  a  subsequent  subsection) . 

The  next  step  was  to  develop  the  two  types  of  alternative  equation 
sets  discussed  previously.  For  the  first  type,  this  consisted  of 
selecting  the  "best"  estimating  relationship  for  each  of  the  "most 
promising"  size/performance  combinations  for  each  cost  element.  For  the 
second  type,  it  consisted  of  selecting  the  single  "best"  estimating 
relationship  for  each  cost  element.  Generally  speaking,  we  tried  to 
select  estimating  relationships  that  satisfied  the  following  conditions: 


* 


1 


•  Each  variable  was  significant  at  the  5  percent  level. 

•  Variables  taken  collectively  were  significant  at  the  5  percent  ® 

level . 

•  They  produced  credible  results. 

•  They  were  free  of  unusual  residual  patterns. 

• 

Once  these  conditions  were  satisfied,  the  objective  was  minimization  of 
the  standard  error  of  estimate.  Traditionally,  cost  analysts  have  tried 

to  achieve  a  standard  error  of  estimate  of  +20  percent  or  better.  For  ® 

logarithmic  models,  this  is  approximately  equivalent  to  0.18  (-16 
percent,  +20  percent). 

The  final  step  was  the  selection  of  a  "most"  representative  set. 

This  final  selection  was  done  primarily  on  the  basis  of  a  comparison  of  ® 

the  individual  equation  standard  errors  of  estimate  and  by  how  well  (in 
terms  of  relative  deviation)  the  sets  as  a  whole  estimated  the  costs  of 
a  subsample  of  four  recent  aircraft. 


Multiple  regression  analysis  was  used  to  examine  the  relationship 
between  cost  and  the  explanatory  variables.  Because  of  time 
restrictions,  only  one  equation  form  was  investigated- -logarithmic- 
linear.  The  logarithmic  equation  form  was  selected  over  the  linear  and 
exponential  equation  forms  by  a  process  of  elimination.  The  linear 
model  was  rejected  because  its  main  analytic  property- -constant  returns 
to  scale--did  not  correspond  to  real  world  expectations.  Of  the  two 
remaining  equation  forms,  the  logarithmic  model  seemed  most  appropriate 
for  the  cost  estimation  process,  since  it  minimized  relative  errors 
rather  than  actual  errors  as  in  the  exponential  model. 

Cost  element  categories  that  are  a  function  of  quantity  were 
examined  at  a  quantity  of  100.  Developing  the  estimating  relationships 
at  a  given  quantity  rather  than  using  quantity  as  an  independent 
variable  in  the  regression  analysis  avoids  the  problem  of  unequal 
representation  of  aircraft  (caused  by  unequal  numbers  of  lots). 

EVALUATION  CRITERIA 

The  estimating  relationships  obtained  in  this  analysis  were 
evaluated  on  the  basis  of  their  statistical  quality,  intuitive 
reasonableness,  and  predictive  properties. 

Statistical  Quality 

Variable  Significance.  Variable  significance  was  used  as  an 
initial  screening  device  to  reduce  the  number  of  estimating 
relationships  requiring  closer  scrutiny.  Normally,  only  those  equations 
for  which  all  variables  were  significant  at  the  5  percent  level  (one¬ 
sided  t-test)  are  reported  in  this  Note.  Occasionally,  however,  this 
criterion  was  relaxed  to  allow  a  useful  comparison  or  so  that  the 
requirement  concerning  the  integrity  of  the  set  size  and  performance 
variables  could  be  examined.  When  an  equation  is  reported  for  which  not 
all  equation  variables  are  significant  at  the  5  percent  level,  it  is 
denoted  as  follows: 


VAR  SIG:  variable  mnemonic 
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Coefficient  of  Determination.  The  coefficient  of  determination  (R  ) 
was  used  to  indicate  the  percentage  of  variation  explained  by  the 
regression  equation. 

Standard  Error  of  Estimate.  The  standard  error  of  estimate  (SEE) 
was  used  to  indicate  the  degree  of  variation  in  the  data  about  the 
regression  equation.  It  is  given  in  logarithmic  form  but  may  be 
converted  into  a  percentage  of  the  corresponding  hour  or  dollar  value  by 
performing  the  following  calculations: 


(a) 


+SEE  , 
e  -1 


(b) 


-SEE  , 
e  - 1 


For  example,  a  standard  error  of  0.18  yields  standard  error  percentages 
of  +20  and  -16. 

F-Statistic.  The  F-statistic  was  used  to  determine  collectively 
whether  the  explanatory  variables  being  evaluated  affect  cost.  Those 
equations  for  which  the  probability  of  the  null  hypothesis  pertaining 
was  greater  than  0.05  have  been  identified  as  follows: 

EQ  SIG:  F-TEST 


Generally  speaking,  equations  so  identified  were  not  considered  for 
inclusion  in  a  representative  equation  set. 

Multicollinearity .  Estimating  relationships  containing  variable 
combinations  with  correlations  greater  than  .70  are  identified  according 
to  the  degree  of  intercorrelation: 


MC0L:  r (variable  mnemonic)  >  * ,  .8,  or  .9 
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where  the  variable  identified  in  parentheses  is  the  equation  variable 
showing  the  greatest  collinearity .  Generally  speaking,  estimating 
relationships  with  intercorrelations  greater  than  .8  were  avoided  when 
selecting  a  representative  equation  set. 

Residual  Plots.  Plots  of  equation  residuals  were  given  cursory 
examinations  for  unusual  patterns.  In  particular,  plots  of  residuals 
versus  predictions  (log/log)  were  checked  to  make  sure  that  the  error 
term  was  normally  distributed  with  zero  mean  and  constant  variance. 
Additionally,  plots  of  residuals  versus  time  (log/linear)  were  examined 
to  see  whether  or  not  the  most  recent  airframe  programs  were  over-  or 
underestimated.  The  existence  of  such  patterns  resulted  in  one  of  the 
following  designations: 

RP:  DIST  (errors  not  normally  distributed) 

RP:  CURrOVER  or  UNDER  (most  recent  aircraft 

over-  or  underestimated) 

Generally  speaking,  we  tried  to  avoid  the  use  of  estimating 
relationships  with  patterns  in  the  representative  equation  sets. 

Influential  Observations.  "Cook’s  Distance"  was  used  to  identify 
influential  observations  in  the  least  squares  estimates.  For  this 
analysis,  an  influential  observation  was  defined  as  one  which,  if 
deleted  from  the  regression,  would  move  the  least  squares  estimate  past 
the  edge  of  the  10  percent  confidence  region  for  the  equation 
coefficients.  Such  observations  are  identified  as  follows: 

10:  aircraft  identification 

When  an  observation  was  consistently  identified  as  influential,  it  was 
reassessed  in  terms  of  its  relevance  to  the  sample  in  question.  If  a 
reasonable  and  uniform  justification  for  its  exclusion  could  be 
developed,  then  the  observation  was  deleted  from  the  sample  and  the 


regressions  rerun  (in  actuality,  this  occurred  only  once--when  the  B-58 
was  deleted  from  the  bomber/transport  sample).  Otherwise,  the 
influential  observation  was  simply  flagged  to  alert  the  potential  user 
to  the  fact  that  its  deletion  from  the  regression  sample  would  result  in 
a  significant  change  in  the  equation  coefficients. 

Reasonableness 

The  development  of  airframe  cost  estimating  relationships  requires 
variable  coefficients  that  both  provide  credible  results  and  conform 
whenever  possible  to  the  normal  estimating  procedures  employed  by  the 
airframe  industry.  Such  credibility  and  conformity  are  reflected  in 
both  the  signs  of  the  variable  coefficients  as  well  as  their  magnitudes. 

Exponent  Sign.  Estimating  relationships  for  which  the  sign  of  the 
variable  coefficient  was  not  consistent  with  a  priori  notions  (see  Table 
4)  are  identified  in  the  following  manner: 

EXP  SIGN:  variable  mnemonic 

Estimating  relationships  containing  such  inconsistencies  were  not 
considered  for  inclusion  in  the  representative  equation  sets. 

Exponent  Magnitude.  Close  attention  was  also  paid  to  the 
magnitude  of  variable  coefficients.  This  applied  to  exponents  that  were 
felt  to  be  too  small  as  well  as  to  those  that  were  felt  to  be  too  large. 
Estimating  relationships  containing  such  variable  coefficients  are 
identified  as  follows: 

EXP  MAG:  variable  mnemonic 

Although  determinations  of  this  kind  are  largely  subjective,  there 
was  one  application  that  was  relatively  objective.  Traditionally,  size 
variables  have  always  provided  returns  to  scale  in  the  production- 
oriented  cost  elements  (tooling,  labor,  material,  and  total  program 
cost).  That  is,  increases  in  airframe  size  are  accompanied  by  less  than 
proportionate  increases  in  cost.  If  the  opposite  phenomenon  is 
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observed,  then  it  is  generally  believed  to  be  the  result  of  not 
adequately  controlling  for  differences  in  construction,  materials, 
complexity,  or  other  miscellaneous  production  factors.  Consequently, 
equations  possessing  a  size-variable  coefficient  greater  than  one  were 
always  flagged. 

When  selecting  a  representative  equation  set,  we  generally  tried  to 
avoid  estimating  relationships  containing  variables  with  exponents  that 
we  felt  were  either  too  large  or  too  small  (that  is,  exponents  that 
placed  either  too  much  or  too  little  emphasis  on  the  parameters  in 
question).  More  restrictively ,  for  the  production-oriented  cost 
elements,  no  estimating  relationship  possessing  a  size-variable  exponent 
greater  than  one  was  considered  for  a  representative  equation  set. 

Predictive  Properties 

Confidence  in  the  ability  of  an  equation  to  accurately  estimate  the 
acquisition  cost  of  a  future  aircraft  is  in  large  part  dependent  on  how 
well  the  acquisition  costs  of  the  most  recently  produced  aircraft  are 
estimated.  Normally,  statistical  quality  and  predictive  capability 
would  be  viewed  as  one  and  the  same.  Unfortunately,  when  dealing  with 
airframe  costs  this  is  not  always  the  case  because  our  knowledge  of  what 
drives  airframe  costs  is  limited  and  because  the  sample  is  relatively 
small  in  size  and  not  evenly  distributed  with  respect  to  first  flight 
date  (see  Fig.  2).  Consequently,  the  estimating  relationships  were  also 
evaluated  on  the  basis  of  how  well  costs  for  a  subset  of  the  most  recent 
aircraft  in  the  database  are  estimated. 

An  indication  of  an  equation's  predictive  capability  would  usually 
be  obtained  by  excluding  a  few  of  the  most  recent  aircraft  from  the 
regression  and  then  seeing  how  well  (in  terms  of  the  relative  deviation) 
the  resultant  equation  estimates  the  excluded  aircraft.  However,  in 
this  case,  the  small  sample  size  precluded  this  option.  Consequently, 
the  measure  of  predictive  capability  used  in  this  analysis  was  the 
average  of  the  absolute  relative  deviations  for  the  A-10,  C-141,  F-14, 


Note:  Only  aircraft  in  the  RANO  airframe  cost  data  base  are  reflected  in  this  figure. 
Consequently,  the  figure  specifically  excludes  the  first  flights  of  modification 
aircraft,  aircraft  that  never  entered  production  (e.g.,  the  F-107),  and  recent  aircraft 
for  which  a  production  quantity  of  100  has  not  yet  been  reached  (e.g.,  the  B-1B). 

Fig.  2— Number  of  first  flight  events  as  a  function  of  the  year  of  first  flight 


and  F-15.  These  relative  deviations  were  determined  on  the  basis  of  the 
predictive  form  of  the  equation  and  not  the  logarithmic  form  used  in  the 
regression. * 

6 If  cost  is  estimated  in  a  log-linear  form  such  as 

*n  COST  =  &0  +  &1  in  WEIGHT  +  &2  in  SPEED  +  in  z 

the  expected  cost  is  given  by 


/  0  P1 

COST  =  e  WEIGHT  1  SPEED  i 

-2 

where  o  is  the  actual  variance  of  e  in  the  log-linear  equation.  Since 
the  actual  variance  is  not  known,  the  standard  error  of  the  estimate  may 
be  used  as  an  approximation. 


III.  SELECTION  OF  SET  SIZE/PERFORMANCE  COMBINATIONS 


On  the  basis  of  a  summary  examination  of  all  two-variable 
estimating  relationships  (size/performance)  for  all  cost  elements,  it 
was  decided  to  develop  four  distinct  equation  sets  that  maintain  the 
integrity  of  the  set  size/performance  parameters: 

Airframe  unit  weight  and  speed 
Airframe  unit  weight  and  climb  rate 
Empty  weight  and  speed 
Empty  weight  and  climb  rate 

Generally  speaking,  the  equations  containing  the  size  variable  wetted 
area  had  higher  standard  errors  of  estimate  than  those  equations 
containing  airframe  unit  weight  or  empty  weight.  With  respect  to  the 
performance  parameters,  the  useful  load  variable  was  rarely  found  to  be 
significant.  On  the  other  hand,  estimating  relationships  containing  the 
variable  "speed  class”  were  roughly  comparable  to  those  containing  the 
variable  "speed."  However,  given  a  choice,  one  would  prefer  to  use  a 
continuous  variable.  Therefore,  speed  class,  since  it  offered  no  real 
advantage  over  speed,  was  not  carried  through  as  a  set  performance 
variable . 
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IV.  ENGINEERING 


Engineering  hours  per  pound  are  plotted  as  a  function  of  airframe 
unit  weight  in  Fig.  3.  Estimating  relationships  in  which  all  equation 
variables  are  significant  at  the  5  percent  level  are  provided  in  Table  5. 

GENERAL  OBSERVATIONS 

1.  With  the  exception  of  the  four  equations  incorporating  the 
number  of  black  boxes  (E13  -  E16) ,  the  estimating  relationships  show  a 
definite  tendency  to  underestimate  the  engineering  hours  of  the  most 
recent  sample  aircraft. 

2.  The  magnitude  of  the  black  box  exponent  in  equations  E13 
through  E16  seems  somewhat  excessive  when  applied  to  bomber/transport 
aircraft.  That  is,  a  50  percent  increase  in  the  number  of  black  boxes 
would  increase  total  engineering  hours  by  about  35  percent.  Such  a 
result  may  be  reasonable  for  a  fighter  or  attack  aircraft  with  little 
available  space  but  seems  excessive  for  a  large  bomber  or  transport 
aircraft . 

3.  The  magnitude  of  the  contractor  experience  designator  shows  a 
great  deal  of  variability  depending  on  whether  or  not  the  black  box 
variable  is  also  included  in  the  equation  (E17,  E19,  and  E20  compared 
with  E23  through  E25).  Furthermore,  in  the  first  group  (E17,  E19,  and 
E20)  the  exponent  magnitude  seems  fairly  large.  For  example,  from 
equation  E19,  a  contractor  without  experience  would  incur  75  percent 
more  engineering  hours  than  a  contractor  with  experience. 

4.  The  estimating  relationships  containing  the  program  type 
designator  (E18  and  E21)  indicate  that  a  prototype  development  approach 
would  require  30  percent  fewer  engineering  hours  than  a  concurrent 
development  approach.  Although  one  might  expect  prototype  programs  to 
incur  somewhat  less  engineering  because  of  their  general  emphasis  on 
austerity,  a  difference  of  this  magnitude  seems  excessive. 


REPRESENTATIVE  CERS 
Airframe  Unit  Weight  and  Speed 

Candidate  estimating  relationships  are  E4,  E13,  E17,  E18,  and  E23. 
Equations  E13,  E17,  E18,  and  E23  are  eliminated  for  reasons  of  exponent 
magnitude.  Unfortunately,  the  remaining  equation  (E4)  shows  a  tendency 
to  underestimate  the  most  recent  aircraft  in  the  sample.  However,  since 
there  are  no  other  possibilities,  E4  is  selected  as  the  representative 
AUW/SP  estimating  relationship  for  the  engineering  cost  element: 

2 

R  SEE  F  N  RP 

.758  1.03  . 

£4  ENGR  =  .00445  AUW  SP  .71  .49  36  32  CUR: UNDER 

100  (.000)  (.000) 


Airframe  Unit  Weight  and  Climb 

Candidate  estimating  relationships  are  E6,  E14,  E19,  and  E24. 
Equations  E14,  E19,  and  E24  are  eliminated  for  reasons  of  exponent 
magnitude.  Thus,  E6  is  the  representative  AUW/CLIMB  estimating 
relationship  for  the  engineering  cost  element  even  though  it  shows  a 
tendency  to  underestimate  current  aircraft: 

2 

R  SEE  F  N  RP 

.830  .510  . 

E6  ENGR  =  .0150  AUW  CLIMB  .71  .49  36  32  CUR: UNDER 

100  (.000)  (.000) 


Empty  Weight  and  Speed 

Candidate  estimating  relationships  are  E7 ,  E15,  E20,  E21,  and  E25 . 
Equations  E15,  E20 ,  E21,  and  E25  are  eliminated  for  reasons  of  exponent 
magnitude.  Unfortunately,  the  remaining  equation  ( E 7 )  shows  a  tendency 
to  underestimate  the  most  recent  aircraft  in  the  sample.  However,  since 


there  are  no  other  possibilities,  E7  is  selected  as  the  representative 
EW/Sb  estimating  relcu-ionship: 


2 

R  SEE  F  N  RP 

.787  .980  . 

E7  ENGR  =  .00355  EW  SP  .70  .50  34  32  CUR: UNDER 

100  (.000)(.000) 


Empty  Weight  and  Climb 

Candidate  estimating  relationships  are  E9 ,  E16,  and  E22.  Equations 
E16  and  E22  are  eliminated  for  reasons  of  exponent  magnitude.  Thus,  E9 
is  the  representative  EW/CL1MB  estimating  relationship  for  the 
engineering  cost  element  even  though  it  shows  a  tendency  to 
underestimate  current  aircraft: 


2 

R  SEE  F  N  RP 

.862  .485  . 

E9  ENGR  =  .0100  EW  CLIMB  .70  .50  34  32  CUR: UNDER 

100  (.000)  (.000) 


Single  Best  Estimating  Relationship 

Based  on  a  summary  examination  of  all  25  engineering  equations,  the 
list  of  candidate  estimating  relationships  was  narrowed  to  include  the 
four  equations  discussed  above  plus  E5  and  E8.  Of  the  six  CEKs ,  E5  and 
E8,  which  are  essentially  equivalent,  have  the  lowest  standard  errors  of 
estimate.  Equation  E5  is  arbitrarily  selected: 

o 

R  SEE  F  N  RP 

.733  .925 

E5  ENGR  =  3. 2d  AUV  SPCLS  .74  .46  42  32  CUR: UNDER 

100  (.000}  (.000) 
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SUMMARY 

of  th“  representative  CERs  shows  a  tendency  to  ’inderest imate 
the  engineering  effort  for  the  most  recent  aircraft  in  the  sample. 
Furthermore,  the  standard  errors  of  estimate  for  the  representative  CERs 
are  all  considerably  greater  than  the  goal  of  0.18.  Additionally,  the 
exponents  of  the  construction/program  variables  determined  to  be 
significant  at  the  5  percent  level  (number  of  black  boxes,  contractor 
experience  designator,  and  program  type  designator)  produce  results  that 
are  not  credible. 


Natural  logarithm  of  engineering  hours  per  pound 
of  airframe  unit  weight  (CA  at  Q  =  100) 
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Fig.  3— Engineering  hours  per  pound  as  a  function 
of  airframe  unit  weight 


ENGINEERING  HOUR  ESTIMATING  RELATIONSHIPS 
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Table  5  (continued) 
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V.  TOOLING 

I 

Tooling  hours  per  pound  are  plotted  as  a  function  of  airframe  unit 
weight  in  Fig.  4.  Estimating  relationships  in  which  all  equation 
I  variables  are  significant  at  the  5  percent  level  are  provided  in  Table  6. 

GENERAL  OBSERVATIONS 

1.  In  general,  the  estimating  relationships  have  relatively  high 

I  standard  errors  of  estimate,  but  on  the  other  hand,  they  are  relatively 

free  of  residual  patterns. 

2.  The  magnitude  of  the  engine  location  variable  seems  high. 
Equations  T13  and  T14  indicate  that  an  aircraft  with  engines  mounted  in 
nacelles  under  the  wing  will  incur  40  percent  to  50  percent  more  tooling 
hours  than  an  aircraft  with  engines  embedded  in  the  fuselage. 

3.  Other  than  the  engine  location  variable,  no 
construction/program  variables  were  found  significant  at  the  5  percent 

i 

I  level  in  any  of  the  prescribed  variable  combinations. 

REPRESENTATIVE  CERS 
Airframe  Unit  Weight  and  Speed 

I  Candidate  estimating  relationships  are  T4  and  T13.  Equation  T13  is 

eliminated  for  reasons  of  exponent  magnitude.  Equation  T4  is  preferred: 

2 

R  SEE  F  N  RP 

.699  .609  . 

T4  TOOL  =  .127  AUW  SP  .74  .40  41  32  None 

100  (.000)  (.001) 
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Airframe  Unit  Weight  and  Climb 

The  only  candidate  estimating  relationship  is  T6: 


.724  .249 

T6  TOOL  =  .502  AUW  CLIMB 
100  (.000)  (.005) 


R  SEE  F  N  RP 


.70  .43  34  32  None 


Empty  Weight  and  Speed 

Candidate  estimating  relationships  are  T7  and  T14.  Equation  T14  is 
eliminated  for  reasons  of  exponent  magnitude.  Equation  T8  is  preferred: 


.755  .570 

T7  TOOL  =  .0695  EW  SP 

100  (,000)(.001) 


R  SEE  F  N  RP 


.78  .37  52  32  None 


Empty  Weight  and  Climb 

The  only  candidate  estimating  relationship  is  T9: 


R  SEE  F  N  RP 

.784  .238  . 

T9  TOOL  =  .227  EW  CLIMB  .75  .39  44  32  None 

100  (.0001  f.004) 


Single  Best  Estimating  Relationship 

Based  on  a  summary  examination  of  all  14  tooling  equations,  the 
list  of  candidate  estimating  relationships  has  been  narrowed  to  the  four 
equations  discussed  above.  Of  these  equations,  T7  has  the  lowest 
standard  error  of  estimate: 

2 

R  SEE  F  N  RP 

.755  .570  ---  . 

T7  TOOL  =  .0695  EW  SP  .78  .37  52  32  None 

100  ( . 000) ( . 001 ) 


SUMMARY 

The  standard  errors  of  estimate  of  the  representative  CERs  are 
roughly  double  the  goal  of  0.18.  Additionally,  the  exponent  of  the 
construction/program  variable  found  to  be  significant  at  the  5  percent 
level  (engine  location  designator)  produces  results  that  are  not 
credible . 


Natural  logarithm  of  tooling  hours  per  pound 
of  airframe  unit  weight  (CA  at  Q  =  100) 


8  9  10  11  12  13 


Natural  logarithm  of  airframe  unit  weight 

Fig.  4— Iboling  hours  per  pound  as  a  function 
of  airframe  unit  weight 
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VI.  MANUFACTURING  LABOR 

Manufacturing  labor  hours  per  pound  are  plotted  as  a  function  of 
airframe  unit  weight  in  Fig.  5.  Estimating  relationships  in  which  all 
equation  variables  are  significant  at  the  5  percent  level  are  provided 
in  Table  7. 

GENERAL  OBSERVATIONS 

1.  Generally  speaking,  the  total  sample  estimating  relationships 
represent  reasonably  good  fits  and  are,  with  one  exception,  free  of 
residual  patterns. 

2.  As  adjuncts  to  various  combinations  of  size  and  performance 
variables,  two  construction/program  variables  (EWAUW  and  TOOLCP)  were 
determined  to  be  significant  at  the  5  percent  level.  However,  only  one 
of  them  (EWAUW)  was  also  found  to  be  significant  in  a  more  limited 
analysis  of  11  post-1960  aircraft.  And  even  the  EWAUW  variable  had 
difficulties--its  exponent  in  the  post-1960  analysis  increased  by  a 
factor  of  two  over  the  full  32-aircraft  sample. 

REPRESENTATIVE  CERS 
Airframe  Unit  Weight  and  Speed 

Candidate  estimating  relationships  are  L4,  L13,  and  L16.  Equations 
L13  and  L16  are  eliminated  because  of  the  previously  alluded  to 
variability  in  the  EWAUW  exponent  between  the  total  and  post-1960 
samples.  That  leaves  equation  L4 : 

2 

R  SEE  F  N  RP 
.801  .429  . 

L4  LABR  =  .329  AUW  SP  .86  .31  88  32  None 

100  (.000)  (.002) 


Airframe  Unit  Weight  and  Climb 

Candidate  estimating  relationships  are  L6,  L14,  and  L17.  Equations 
L14  and  L17  are  eliminated  because  of  the  previously  alluded  to 
variability  in  the  EWAUW  exponent  between  the  total  and  post- 1960 
samples.  That  leaves  equation  L6: 


2 

R  SEE  F  N  RP 

.822  .186  . 

L6  LABR  =  .757  AUW  CLIMB  .85  .32  80  32  None 

100  (.000)  (.006) 


Empty  Weight  and  Speed 

Candidate  estimating  relationship  are  L7  and  L15.  L15  is 

eliminated  from  consideration  because  the  variable  T00LCP  was  not  also 
significant  in  the  more  limited  analysis  of  post-1960  aircraft.  That 
leaves  L7 : 


.852  .379 

L7  LABR  =  . 198  EW  SP 

100  (,0n0)(.002) 


2 

R  SEE  F  N  RP 


.88  .28  109  32  None 


Empty  Weight  and  Climb 

The  only  candidate  estimating  relationship  is  L9 : 


L9  LABR 


.874  .168 

.383  EW  CLIMB 
(.000)  (.005) 


2 

R  SEE  F  N  RP 


.87  .29  101  32  None 


100 
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Single  Best  Estimating  Relationship 

Based  on  a  summary  examination  of  all  17  manufacturing  labor 
equations,  the  list  of  candidate  estimating  relationships  has  been 
narrowed  to  include  the  four  equations  discussed  above  plus  L5  and  L8 . 
Generally  speaking,  all  possess  approximately  the  same  standard  error  of 
estimate.  Equation  L7  is  arbitrarily  selected. 


.852  .379 

L7  LABR  =  .198  EW  SP 

100  ( . 000) ( . 002) 


2 

R  SEE  F  N  RP 


.88  .28  109  32  None 


SUMMARY 

The  standard  errors  of  estimate  for  the  representative  CERs  are  all 
somewhat  higher  than  the  goal  of  0.18.  Additionally,  although  several 
construction/program  variables  were  found  to  be  significant  at  the  5 
percent  level  (as  adjuncts  to  various  size/performance  combinations), 
each  had  difficulties  that  we  felt  precluded  its  incorporation  in  a 
recommended  CER. 


Natural  logarithm  of  manufacturing  labor  hours  per  pound 
of  airframe  unit  weight  (CA  at  Q  =  100) 
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Fig.  5— Manufacturing  labor  hours  per  pound  as  a 
function  of  airframe  unit  weight 


VII.  MANUFACTURING  MATERIAL 


Manufacturing  material  cost  per  pound  is  plotted  as  a  function  of 
airframe  unit  weight  in  Fig.  6.  Estimating  relationships  in  which  all 
equation  variables  are  significant  at  the  5  percent  level  are  provided 
in  Table  8. 

GENERAL  OBSERVATIONS 

1.  With  the  exception  of  the  four  equations  incorporating  the 
number  of  black  boxes  (M14,  M16,  M18,  and  M19),  there  is  a  definite 
tendency  for  the  material  costs  of  the  most  recent  sample  aircraft  to  be 
underestimated . 

2.  Equations  M14,  M16,  M18,  and  M19  indicate  that  a  50  percent 
increase  in  the  number  of  black  boxes  would  result  in  a  roughly  20 
percent  increase  in  total  airframe  material  costs.  This  large  an 
increase  seems  somewhat  excessive. 

3.  The  magnitude  of  the  engine  location  variable  also  seems  high. 
Equations  M13  and  M17  indicate  that  an  aircraft  with  engines  mounted  in 
nacelles  under  the  wing  will  incur  roughly  45  percent  higher  material 
costs  than  an  aircraft  with  engines  embedded  in  the  fuselage. 

4.  The  contractor  experience  designator  in  equations  M20,  M21,  and 
M22  indicate  that  a  contractor  with  experience  will  incur  30  percent  to 
35  percent  lower  material  costs  than  a  contractor  without  experience,  a 
result  that  is  possible  but  not  particularly  credible. 

REPRESENTATIVE  CERS 
Airframe  Unit  Weight  and  Speed 

Candidate  estimating  relationships  are  M4,  M13,  M14,  and  M20. 
Equations  M13,  M14,  and  M20  are  eliminated  for  reasons  of  exponent 
magnitude.  Unfortunately,  the  remaining  equation  (M4)  shows  a  tendency 
to  underestimate  the  most  recent  aircraft  in  the  sample.  However,  since 
there  are  no  other  possibilities,  M4  is  selected  as  the  representative 
AUW/SP  estimating  relationship: 
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2 

R  SEE  F  N  RP 

.895  .811  . 

M4  MATL  =  .0999  AUW  SP  .84  .38  77  32  CUR: UNDER 

100  (.000)  (.000) 


Airframe  Unit  Weight  and  Climb 

Candidate  estimating  relationships  are  M6,  M15,  and  M16.  Equations 
M15  and  M16  are  eliminated  for  reasons  of  exponent  magnitude. 
Unfortunately,  the  remaining  equation  (M6)  shows  a  tendency  to 
underestimate  the  most  recent  aircraft  in  the  sample.  However,  since 
there  are  no  other  possibilities,  M6  is  selected  as  the  representative 
AUW/CLIMB  estimating  relationship: 

2 

R  SEE  F  N  RP 

.927  .325  . . 

M6  MATL  =  .686  AUW  CLIMB  .79  .43  56  32  CUR -.UNDER 

100  (.000)  (.001) 


Empty  Weight  and  Speed 

Candidate  estimating  relationships  are  M7,  M17,  M18,  and  M21. 
Equations  M17,  M16,  and  M21  are  eliminated  for  reasons  of  exponent 
magnitude.  Unfortunate ly ,  the  remaining  equation  (M7)  shows  a  tendency 
to  underestimate  the  most  recent  aircraft  in  the  sample.  However,  since 
there  are  no  other  possibilities,  M7  is  selected  as  the  representative 
EW/SP  estimating  relationship: 

2 

R  SEE  F  N  RP 

.945  .752  . . 

M7  MATL  =  .0623  EW  SP  .85  .36  83  32  CUR: UNDER 

100  ( . 000 ) ( . 000) 


Empty  Weight  and  Climb 

Candidate  estimating  relationships  are  M9 ,  M19,  and  M22.  Equations 
M19  and  M22  are  eliminated  for  reasons  of  exponent  magnitude. 
Unfortunately,  the  remaining  equation  (M9)  shows  a  tendency  to 
underestimate  the  most  recent  aircraft  in  the  sample.  However,  since 
there  are  no  other  possibilities,  M9  is  selected  as  the  representative 
EW/CLIMB  estimating  relationship: 

2 

R  SEE  F  N  RP 

.980  .303 

M9  MATL  =  .345  EW  CLIMB  .85  .36  85  32  CUR: UNDER 

100  (.000) (.001) 


Single  Best  Estimating  Relationship 

Based  on  a  summary  examination  of  all  22  manufacturing  material 
equations,  the  list  of  candidate  estimating  relationships  has  been 
narrowed  to  the  four  equations  discussed  above.  Of  these  equations,  M4, 
M7 ,  and  M9  have  the  lowest  standard  errors  of  estimate.  Equation  M7  is 
arbitrarily  selected: 

2 

R  SEE  F  N  RP 

.945  .752  . 

M7  MATL  =  .0623  EW  SP  .85  .36  83  32  CUR: UNDER 

100  (.000)  (.000) 


SUMMARY 

The  standard  errors  of  estimate  for  the  representative  CERs  are 
roughly  double  the  goal  of  0.18.  Furthermore,  the  equations  in  which 
construction/program  variables  were  found  to  be  significant  at  the  5 
percent  level  had  difficulties  associated  with  exponent  magnitude  and 
residual  patterns. 


Natural  logarithm  of  manufacturing  material  cost 
per  pound  of  airframe  unit  weight  (CA  at  Q  =  100 
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Fig.  6— Manufacturing  material  cost  per  pound  as  a 
function  of  airframe  unit  weight 


Table  8 

MANUFACTURING  MATERIAL  COST  ESTIMATING  RELATIONSHIPS 
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VIII  DEVELOPMENT  SUPPORT 


Development  support  cost  per  pound  is  plotted  as  a  function  of 
airframe  unit  weight  in  Fig.  7.  Estimating  relationships  in  which  all 
equation  variables  are  significant  at  the  5  percent  level  are  provided 
in  Table  9 . 

GENERAL  OBSERVATIONS 

1.  None  of  the  estimating  relationships  listed  in  Table  14  comes 
close  to  meeting  the  standard  error  of  estimate  goal  of  0.18. 
Furthermore,  there  is  a  definite  tendency  for  the  development  support 
costs  of  the  most  recent  sample  aircraft  to  be  underestimated. 

2.  As  adjuncts  to  various  combinations  of  size  and  performance 
variables,  several  construction/program  variables  were  determined  to  be 
significant  at  the  5  percent  level.  However,  they  provide  relatively 
modest,  if  any,  improvement  in  the  equation  standard  error  of  estimate. 

3.  Equations  D13,  D15,  D16,  and  D19  indicate  that  a  50  percent 
increase  in  the  ratio  of  avionics  weight  to  airframe  unit  weight  will 
result  in  a  25  percent  to  30  percent  increase  in  development  support 
cost.  Similarly,  equations  D14  and  D17  indicate  that  a  50  percent 
increase  in  the  number  of  black  boxes  will  result  in  a  35  percent 
increase  in  development  support  cost.  In  both  instances,  such 
differences  seem  excessive. 

4.  The  estimating  relationships  containing  the  program  type 
designator  (D20,  D21,  and  D22)  indicate  that  a  prototype  development 
approach  would  incur  about  40  percent  as  much  development  support  cost 
as  a  concurrent  development  approach.  Such  a  difference  is  not 
credible . 


REPRESENTATIVE  CERS 
Airframe  Unit  Weight  and  Speed 

Candidate  estimating  relationships  are  D4,  D13,  D14,  and  D20.  All 
but  equation  D4  are  eliminated  for  reasons  of  exponent  magnitude.  Un¬ 
fortunately,  equation  D4  shows  a  tendency  to  underestimate  the  most 
recent  aircraft  in  the  sample. 

2 

R  SEE  F  N  RP 

.761  1.28  . 

D4  DS  =  .00761  AUV  SP  .50  .82  15  32  CUR: UNDER 

(.000)  (.001) 


Airframe  Unit  Weight  and  Climb 

Candidate  estimating  relationships  are  D6  and  D15.  Equation  D15  is 
eliminated  for  reasons  of  exponent  magnitude.  Unfortunately,  equation 
D6  shows  a  tendency  to  underestimate  the  most  recent  aircraft  in  the 
sample. 

2 

R  SEE  F  N  RP 

.829  .567  . 

D6  DS  =.0780  AUW  CLIMB  .46  .85  12  32  CUR: UNDER 

(.000)  (.002) 


Empty  Weight  and  Speed 

Candidate  estimating  relationships  are  D7 ,  D16,  D17,  and  D21.  All 
but  equation  D7  are  eliminated  for  reasons  of  exponent  magnitude. 
Unfortunately,  equation  D7  shows  a  tendency  to  underestimate  the  most 
recent  aircraft  in  the  sample. 
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R  SEE  F  N 


.818  1.23 

D7  DS  =  .00417  EW  SP 

(.000)(.001) 


.52  .80  16  32  CUR: UNDER 


Empty  Weight  and  Climb 

Candidate  estimating  relationships  are  D9 ,  D18,  D19,  and  D22.  All 
but  equation  D9  are  eliminated  for  reasons  of  exponent  magnitude. 
Unfortunately,  equation  D9  shows  a  tendency  to  underestimate  the  most 
recent  aircraft  in  the  sample. 


R  SEE  F  N 


.894  .553 

D9  DS  =  .0331  EW  CLIMB 

(.000)  (.002) 


.49  .83  14  32  CUR: UNDER 


Single  Best  Estimating  Relationship 

Based  on  a  summary  examination  of  all  22  development  support 
equations,  the  list  of  candidate  estimating  relationships  was  narrowed 
to  include  the  four  equations  discussed  above  plus  D5  and  D8.  All  show 
a  tendency  to  underestimate  the  most  recent  sample  aircraft.  Equation 
D8  is  selected  because  it  has  the  lowest  standard  error  of  estimate: 


R  SEE  F  N 


.794  1.08 

D8  DS  =  10.5  EW  SPCLS 

(.000)  (.000) 


.54  .78  17  32  CUR: UNDER 


SUMMARY 

Each  of  the  representative  CERs  shows  a  tendency  to  underestimate 
development  support  costs  for  the  most  recent  aircraft  in  the  sample. 
Furthermore,  the  standard  errors  of  estimate  for  the  representative  CERs 
are  all  much  larger  than  the  goal  of  0.18.  Finally,  the  exponents  of 
the  construction/program  variables  found  to  be  significant  at  the  5 
percent  level  (number  of  black  boxes,  ratio  of  avionics  weight  to 
airframe  unit  weight,  and  the  program  type  designator)  produce  results 
that  are  not  credible. 


Natural  logarithm  of  development  support  cost  per  pound 
of  airframe  unit  weight 
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Fig.  7— Development  support  cost  per  pound  as  a 
function  of  airframe  unit  weight 
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IX.  FLIGHT  TEST 

Flight  test  cost  per  aircraft  is  plotted  as  a  function  of  the 
quantity  of  flight  test  aircraft  in  Fig.  8.  Estimating  relationships  in 
which  all  equation  variables  are  significant  at  the  5  percent  level  are 
provided  in  Table  10. 

GENERAL  OBSERVATIONS 

1.  In  general,  the  flight  test  estimating  relationships  have 
relatively  high  standard  errors  of  estimate  compared  to  the  goal  of 
0.18.  On  the  other  hand,  with  the  exception  of  those  equations 
incorporating  the  speed  class  designator,  they  are  relatively  free  of 
residual  patterns. 

2.  The  magnitude  of  the  test  aircraft  variable  is  less  than  one 
only  when  a  performance  variable  is  included  in  the  equation. 
Additionally,  the  magnitude  of  the  test  aircraft  exponent  varies 
considerably  depending  on  what  other  variables  are  included  in  the 
equation . 

3.  The  exponents  associated  with  three  of  the  construction 
variables  seem  fairly  large  although  we  are  not  able  to  say  they  are  not 
credible.  Equations  F14,  F19,  F23,  and  F28  indicate  that  a  carrier- 
capable  aircraft  will  incur  flight  test  costs  60  percent  to  70  percent 
greater  than  those  of  a  land-based  aircraft.  Equations  F15,  F20,  F24, 
and  F29  indicate  that  a  variable-sweep  aircraft  will  incur  flight  test 
costs  80  percent  to  120  percent  greater  than  a  swept-wing  aircraft.  And 
finally,  equations  F16,  F21,  F25,  and  F30  indicate  that  a  30  percent 
increase  in  the  EWAUW  value  will  result  in  a  20  percent  to  35  percent 
increase  in  flight  test  costs. 

4.  The  equations  containing  the  black  box  variable  (F18,  F22,  and 
F27)  all  do  very  poorly  with  respect  to  F-15  flight  test  costs. 


4 
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REPRESENTATIVE  CERS 

Airframe  Unit  Weight  and  Speed  4 

Candidate  estimating  relationships  are  F5,  F14,  F15,  F16,  F17,  and 
F18.  Equations  F14,  F15,  and  F16  are  ruled  out  because  of  previously 
discussed  reservations  concerning  the  magnitude  of  the  construction 

variable  exponents.  Equatior  F18  is  ruled  out  because  of  its  poor  _S 

performance  with  respect  to  the  F-15.  Of  the  two  remaining  estimating 
relationships,  F5  is  preferred  to  F17  because  there  is  little  difference 
statistically  and  F5  contains  fewer  variables: 

4 

2 

R  SEE  F  N  RP 

.584  1.27  .805  . 

F5  FT  =  .00617  AUW  SP  TESTAC  .71  .60  23  32  None 

(.000)  (.000)  (.002)  a 


Airframe  Unit  Weight  and  Climb 

Candidate  estimating  relationships  are  F7 ,  F19,  F20,  F21,  and  F22.  4 

Equations  F19,  F20,  and  F21  are  ruled  out  because  of  previously 
discussed  reservations  concerning  the  magnitude  of  the  construction 
variable  exponents.  Equation  F22  is  ruled  out  because  of  its  poor 

performance  with  respect  to  the  F-15.  This  leaves  equation  F7  as  the  4 

only  survivor: 


.641  .512  .916 


F7  FT  =  .0859  AUW  CLIMB 

(.000)  (.002) 


TESTAC 

(.001) 


2 

R  SEE  F  N  RP 


.65  .66  18  32  None 


< 


( 


Empty  Weight  and  Speed 

Candidate  estimating  relationships  are  F8,  F23,  F24,  F25 ,  F26,  and 
F27.  Equations  F23,  F24,  and  F25  are  ruled  out  because  of  previously 
discussed  reservations  concerning  the  magnitude  of  the  construction 
variable  exponents.  Equation  F27  is  ruled  out  because  of  its  poor 
performance  with  respect  to  the  F-15.  Of  the  two  remaining  estimating 
relationships,  F8  is  preferred  to  F26  because  there  is  little  difference 
statistically  and  F8  contains  fewer  variables: 

2 

R  SEE  F  N  RP 

.644  1.27  .767  . . 

F8  FT  =  .00293  EW  SP  TESTAC  .74  .58  26  32  CUR: UNDER 

(.000)  (.000)  (.002) 


Empty  Weight  and  Climb 

Candidate  estimating  relationships  are  F10,  F28,  F29 ,  F30,  and  F31 . 
Equations  F28,  F29,  and  F30  are  ruled  out  because  of  previously 
discussed  reservations  concerning  the  magnitude  of  the  construction 
variable  exponents.  Of  the  two  remaining  equations,  F31  is  preferred  to 
F10  because  of  its  lower  standard  error  of  estimate: 

2 

R  SEE  F  N  RP 

.877  .571  .488  .491  . 

F31  FT  =  .0332  EW  CLIMB  AVAUV  TESTAC  .71  .56  13  27  None 

(.000)  (.000)  (.006)  (.049) 


Single  Best  Estimating  Relationship 

based  on  a  summary  examination  of  all  01  flight  test  equations,  the 
i:st  of  candidate  estimating  relationships  has  been  narrowed  to  the  four 
equations  discussed  above. .  Of  the  four  possibilities,  F3,  F8 ,  and  F31 
are  all  on  about  the  same  level.  Equation  F8  is  arbitrarily  selected: 
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2 

R  SEE  F  N  RP 

.644  1.27  .767  . 

F8  FT  =  .00293  EW  SP  TESTAC  .74  .58  26  32  None 

(.000)  ( . 000) ( . 002 ) 


SUMMARY 

The  standard  errors  of  estimate  for  the  representative  CERs  are  all 
considerably  greater  than  the  goal  of  0.18.  Additionally,  the  exponents 
of  three  of  the  five  construction  variables  determined  to  be  significant 
at  the  5  percent  level  (carrier  capable  designator,  wing  type 
designator,  and  the  ratio  of  empty  weight  minus  airframe  unit  weight  to 
airframe  unit  weight)  produce  results  that  seem  extreme.  The  other  lwo 
construction  variables  determined  to  be  significant  at  the  5  percent 
level  provided  relatively  modest  reductions  in  the  standard  error  of 
estimate  for  the  equations  into  which  they  were  incorporated. 


Fig.  8— Flight  test  cost  per  test  aircraft  as  a  function  of 
the  quantity  of  flight  test  aircraft 


FLIGHT  TEST  COST  ESTIMATING  RELATIONSHIPS 
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X.  QUALITY  CONTROL 


Quality  control  hours  per  pound  are  plotted  as  a  function  of 
airframe  unit  weight  in  Fig.  9.  Estimating  relationships  in  which  all 
equation  variables  are  significant  at  the  5  percent  level  are  provided 
in  Table  11. 

GENERAL  OBSERVATIONS 

1.  All  18  equations  listed  in  Table  10  show  a  tendency  to 
underestimate  the  quality  control  hours  for  the  most  recent  aircraft  in 
the  sample. 

2.  The  standard  errors  of  estimate  of  those  equations 
incorporating  construction/program  variables  (Q13  through  Q18)  are  only 
slightly  lower  than  the  standard  errors  of  estimate  of  analogous 
equations  not  incorporating  construction/program  variables. 

3.  The  magnitude  of  the  exponents  associated  with  the  contractor 
experience  designator  seems  somewhat  large.  Equations  Q15  through  Q18 
indicate  that  a  contractor  without  relevant  experience  will  incur  40 
percent  to  50  percent  more  quality  control  hours  than  a  contractor  with 
relevant  experience. 

REPRESENTATIVE  CERS 

Previous  RAND  airframe  models  have  estimated  quality  cont  cl  hours 
as  a  percentage  of  manufacturing  labor  hours.  Because  all  of  the 
equations  listed  in  Table  11  exhibit  a  tendency  to  underestimate  the 
quality  control  hours  of  the  most  recent  aircraft  in  the  sample,  the 
simpler  factor  approach  will  again  be  used.  The  recommended  factors, 
based  on  the  data  shown  in  Table  12,  are  as  follows: 

Quality  Control  Hours 

as  %  of  Manufacturing  Mission 

Labor  Hours  Type 


8.5 

12.5 


Cargo 
Nor.  -cargo 


Natural  logarithm  of  quality  control  hours  per  pound 
of  airframe  unit  weight  (CA  at  Q  =  100) 
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Fig.  9— Quality  control  hours  per  pound  as  a 
function  of  airframe  unit  weight 


QUALITY  CONTROL  HOUR  ESTIMATING  RELATIONSHIPS 
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=  .0430  EW  CLIMB  .71  .47  21  20  +21  -211  -19  +24  69  RP:CUR:UNDER 

100  (.000)  (.024)  IO.-C-141 


Statistics  Relative  Deviations  (%) 
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Table  12 

QUALITY  CONTROL  HOURS  AS  A  PERCENTAGE  OF  MANUFACTURING 
LABOR  HOURS  (AT  Q  =  100) 


Aircraft 

QC  Percentage 

A-5 

9.8 

A-b 

7.6 

A- 7 

10.4 

A- 10 

14.0 

B-52 

9.5 

B-58 

16.3 

C-5 

9.7 

KC- 135 

10.3 

C- 141 

5.4 

F-4 

7.6 

F-100 

12.3 

F- 102 

6.9 

F*  105 

10.1 

F- 106 

17.2 

F-lll 

16.2 

F- 14 

11.6 

F- 15 

18.1 

T-38 

14.4 

T-39 

11.3 

S-3 

17.1 

Average,  all  aircraft 

11.8 

Average,  cargo  aircraft 

8.5 

Average,  non-cargo  aircraft 

12.5 
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XI.  TOTAL  PROGRAM  COST 


Total  program  cost  per  pound  is  plotted  as  a  function  of  airframe 
unit  weight  in  Fig.  10.  Estimating  relationships  in  which  all  equation 
variables  are  significant  at  the  5  percent  level  are  provided  in  Table 
13. 


GENERAL  OBSERVATIONS 

1.  With  the  exception  of  the  equations  incorporating  the  black  box 
variable  (P16,  P21,  P34 ,  P39 ,  and  P41),  there  is  a  definite  tendency  for 
the  full-sample  equations  to  underestimate  the  program  costs  of  the  most 
recent  sample  aircraft. 

2.  With  the  exception  of  the  wing  type  designator,  the 
construction  variables  that  show  up  as  significant  at  the  5  percent 
level  relate  to  the  equipment  placed  within  the  airframe  structure 
(BLBOX,  AVAUV,  and  EWAUWj  rather  than  to  the  structure  itself. 

3.  Of  the  four  construction  variables  that  were  determined  to  be 
significant  in  the  total  sample  (BLBOX,  WGTYPE,  AVAUW,  and  EWAUW),  only 
two  of  them--AVAUW  and  EWAUW--were  also  found  to  be  significant  in  a 
more  limited  analysis  of  11  post-1960  aircraft.  And  even  these  two  had 
dif f iculties--the  magnitude  of  the  EWAUW  exponent  in  the  post-1960 
analysis  increased  by  a  factor  of  two  to  three  over  the  full  32-aircraft 
sample,  whereas  the  magnitude  of  the  AVAUW  exponent  increased  by  roughly 
a  factor  of  two. 

4.  The  three  program  variables  appearing  in  Table  13  have 
interesting  implications.  Based  on  minimum  and  maximum  exponent  values, 
the  following  results  are  obtained: 

a.  A  contractor  without  relevant  experience  would  incur  costs  25 
percent  to  40  percent  greater  than  a  contractor  with  relevant 
experience . 
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b.  A  prototype  development  approach  would  incur  only  70  percent  to 
80  percent  of  the  costs  of  a  concurrent  development  approach. 

c.  An  airframe  using  a  new  engine  would  incur  costs  approximately 
20  percent  higher  than  an  airframe  using  an  off-the-shelf 
engine . 

Although  we  cannot  say  that  such  results  are  unreasonable,  they  do  seem 
extreme  and  clearly  highlight  the  difficulty  associated  with  using 
simple  yes/no  variables--there  is  no  middle  ground.  Furthermore,  none 
of  these  three  program  variables  that  were  determined  to  be  significant 
at  the  5  percent  level  in  the  32-aircraft  sample  analysis  was  found  to 
be  significant  in  a  more  limited  analysis  of  11  post-1960  aircraft. 

REPRESENTATIVE  CERS 
Airframe  Unit  Weight  and  Speed 

Candidate  estimating  relationships  are  P4,  P13,  P14,  P15,  P16,  P24, 
P30,  P31,  P32,  P33,  and  P34.  As  stated  in  the  general  observations, 
each  construction  and  program  variable  has  difficulties  that  we  feel 
preclude  its  incorporation  in  a  recommended  CER.  Consequently,  equation 
P4  is  selected  even  though  it  has  a  tendency  to  underestimate  the 
program  costs  of  the  most  recent  sample  aircraft: 

2 

R  SEE  F  N  RP 

.779  .745  ---  . 

P4  PROG  =  3.56  AUW  SP  .85  .31  85  32  CUR : UNDER 

100  (.000)  (.000) 


Airframe  Unit  Weight  and  Climb 

Candidate  estimating  relationships  are  P6 ,  P17,  P18,  P19,  P25 ,  P35 , 
P3fc> ,  P37,  P38 ,  and  P39 .  As  stated  in  the  general  observations,  each 
construction  and  program  variable  has  difficulties  that  we  feel  preclude 
its  incorporation  in  a  recommended  CER.  Thus,  equation  P6  is  selected 
as  the  AUW/CLIMB  estimating  relationship  even  though  it  has  a  tendency 
to  underestimate  the  mos ^  recent  sample  aircraft: 
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2 

R  SEE  F  N  RP 

.817  .326  . 

P6  PROG  =  14.6  AUW  CLIMB  .82  .35  66  32  CUR: UNDER 

100  (.000)  (.000) 


Empty  Weight  and  Speed 

Candidate  estimating  relationships  are  P7 ,  P20,  P21,  P26,  P27,  P40, 
and  P41.  As  stated  in  the  general  observations,  each  construction  and 
program  variable  has  difficulties  that  we  feel  preclude  its 
incorporation  in  a  recommended  CER.  Consequently,  equation  P7  is 
arbitrarily  selected  even  though  it  has  a  tendency  to  underestimate  the 
program  costs  of  the  most  recent  sample  aircraft: 

2 

R  SEE  F  N  RP 

.828  .696  . 

P7  PROG  =  2.19  EW  Sf  .86  .29  102  32  CUR: UNDER 

100  (,000)(.000) 


Empty  Weight  and  Climb 

Candidate  estimating  relationships  are  P9 ,  P22,  P23,  P28,  P29,  P42 , 
and  P43.  As  stated  in  the  general  observations,  each  construction  and 
program  variable  has  difficulties  that  we  feel  preclude  its 
incorporation  in  a  recommended  CER.  Thus,  equation  P9  is  selected  as 
the  EW/CLIMB  estimating  relationship  even  though  it  has  a  tendency  to 
underestimate  the  most  recent  sample  aircraft: 

O 

(- 

R  SEE  F  N  RP 

.869  .308  ---  ---  --  --  - 

P9  PROG  =7.38  EW  CLIMB  .85  .32  82  32  CUR: UNDER 

(.000)  (.000) 


100 


Single  Best  Estimating  Relationship 

Based  on  a  summary  examination  of  all  43  total  program  cost 
equations,  the  list  of  candidate  estimating  relationships  has  been 
narrowed  to  the  four  equations  discussed  above.  Equation  P7  has  the 
lowest  standard  error  of  estimate  of  the  four  equations  and  is  therefore 
selected: 

2 

R  SEE  F  N  RP 

.828  .696  . 

P7  PROG  =  2.19  EW  SP  .88  .29  102  32  CUR: UNDER 

100  ( . 000) ( . 000) 


SUMMARY 

The  standard  errors  of  estimates  for  the  representative  CERs  are 
all  somewhat  higher  than  the  goal  of  0.18.  Furthermore,  although 
several  of  the  construction/program  variables  were  found  to  be 
significant  at  the  5  percent  level,  each  had  difficulties  that  we  felt 
precluded  its  incorporation  in  a  recommended  CER. 


Natural  logarithm  of  total  program  cost  per  pound 
of  airframe  unit  weight  (CA  at  Q  =  100) 
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Fig.  10— Tbtal  program  cost  per  pound  as  a 
function  of  airframe  unit  weight 


« 


« 


TOTAL  PROGRAM  COST  ESTIMATING  RELATIONSHIPS 


! 


cont 


Table  13  (continued) 


Table  13  (continued) 


! 

i 

t 

k 

» 


Table  13  (continued) 
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XII.  SELECTION  OF  RECOMMENDED  EQUATION  SET 


SUMMARY  OF  PRECEDING  ANALYSIS 

The  representative  equation  sets  for  the  four  size/performance 
variable  combinations  (airframe  unit  weight/speed,  airframe  unit 
weight/climb  rate,  empty  weight/speed,  and  empty  weight/climb  rate)  as 
well  as  the  equation  set  containing  the  "best"  estimating  relationship 
for  each  cost  element  (irrespective  of  the  size/performance  variable 
combination)  are  listed  in  Tables  14  through  18.  A  comparison  of  these 
equation  sets  based  on  the  relative  deviations  of  four  relatively  recent 
sample  aircraft  (A-10,  C-141,  F-14,  and  F-15)  is  provided  in  Table  19. 

On  review  of  these  tables,  the  following  observations  are  made: 


1.  There  is  little  difference  in  the  statistical  quality  of  the 
sets . 

2.  The  engineering,  manufacturing  material,  development  support, 
and  total  program  cost  equations  in  each  set  show  a  tendency  to 
underestimate  the  costs  of  the  most  recent  sample  aircraft. 

3.  On  the  basis  of  comparisons  of:  (a)  the  standard  errors  of 
estimate  of  individual  estimating  relationships,  and  (b) 
relative  deviations  with  respect  to  the  A-10,  C-141,  F-14,  and 
F-15  (Table  19),  there  does  not  appear  to  be  any  advantage  in 
mixing  the  set  size/performance  variables. 

4.  Based  on  comparisons  of  the  A-10,  C-141,  F-14,  and  F-15,  the 
estimates  obtained  by  summing  the  individual  elements  are  in 
remarkably  close  agreement  with  the  estimates  determined  by  the 
total  program  CERs . 

5.  With  the  exception  of  the  number  of  test  aircraft  (for  the 
flight  test  cost  element),  the  construction/program  variables 
were  not  an  influential  factor  in  reducing  the  standard  errors 
of  estimate  of  individual  estimating  relationships. 
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Table  14 


REPRESENTATIVE  SET:  AIRFRAME  UNIT  WEIGHT 

AND 

SPEED 

Estimating  Relationship 

2 

R 

SEE 

F 

N 

Residual 

Pattern 

ENGR 

100 

.758  1.03 

=  .00445  AUW  SP 

(.000)  (.000) 

.71 

.49 

36 

32 

CUR : UNDER 

TOOL 

100 

.699  .609 

=  .127  AUW  SP 

(.000)  (.001) 

.74 

.40 

41 

32 

None 

LABR 

100 

.801  .429 

=  .329  AUW  SP 

(.000)  (.002) 

.86 

.31 

88 

32 

None 

MATL 

100 

.895  .811 

=  .0999  AUW  SP 

(.000)  (.000) 

.84 

.38 

77 

32 

CUR : UNDER 

DS 

.761  1.28 

=  .00761  AUW  SP 

(.000)  (.001) 

.50 

.82 

15 

32 

CUR : UNDER 

FT 

.584  1.27  .805 

=  .00617  AUW  SP  TESTAC 

(.000)  (  .  000) ( . 002 ) 

.71 

.60 

23 

32 

None 

QC 

100 

=  .085  *  LABR  if  cargo  aircraft 

100 

-- 

-- 

-- 

-- 

-- 

=  .125  *  LABR  if  non-cargo  aircraft 

100 

PROG 

.779  .745 

=  3.56  AUW  SP 

.85 

.31 

85 

32 

CUR : UNDER 

100  (.000)  (.000) 


Table  15 


REPRESENTATIVE  SET:  AIRFRAME  UNIT  WEIGHT  AND  CLIMB  RATE 


Estimating  Relationship 


2  Residual 

R  SEE  F  N  Pattern 


.830  .510 

ENGR  =  .0150  AUW  CLIMB 

100  (.000)  (.000) 

.724  .249 

TOOL  =  .502  AUW  CLIMB 

100  (.000)  (.005) 

.822  .186 

LABR  =  .757  AUW  CLIMB 

100  (.000)  (.006) 

.927  .325 

MATL  =  .686  AUW  CLIMB 

100  (.000)  (.001) 


DS 


.829  .567 

.0780  AUW  CLIMB 
(.000)  (.002) 


FT 


.641  .512 

.0859  AUW  CLIMB  TESTAC 

(.000)  (.002)  (.001) 


.916 


QC 


100 


.085  *  LABR  if  cargo  aircraft 
100 


71 

.49 

36 

32 

CUR: UNDER 

70 

.43 

34 

32 

None 

85 

.32 

80 

32 

None 

79 

.43 

56 

32 

CUR: UNDER 

46 

.85 

12 

32 

CUR -.UNDER 

65 

.66 

18 

32 

None 

PROG 

100 


.125  *  LABR  if  non-cargo  aircraft 
100 

.817  .326 

14.6  AUW  CLIMB  .82  .35  66  32  CUR: UNDER 

(.000)  (.000) 


Table  16 

REPRESENTATIVE  SET:  EMPTY  WEIGHT  AND  SPEED 


Estimating  Relationship 

2 

R 

SEE 

F 

N 

Residual 

Pattern 

ENGR 

100 

= 

.787  .980 

.00355  EW  SP 

(.000) (.000) 

.70 

.50 

34 

32 

CUR : UNDER 

TOOL 

100 

= 

.755  .570 

.0695  EW  SP 

(.000)(.001) 

.78 

.37 

52 

32 

None 

LABR 

100 

= 

.852  .379 

.  198  EW  SP 

( . 000) ( . 002) 

.88 

.28 

109 

32 

None 

MATL 

100 

= 

.945  .752 

.0623  EW  SP 

(.000)(,000) 

.85 

.36 

83 

32 

CUR : UNDER 

DS 

= 

.818  1.23 

.00417  EW  SP 

(.000)(.001) 

.52 

.80 

16 

32 

CUR : UNDER 

FT 

.644  1.27  .767 

.00293  EW  SP  TEST AC 

.74 

.58 

26 

32 

CUR : UNDER 

( . 000) ( . 000) ( . 002) 

QC  =  .085  *  LABR  if  cargo  aircraft 

100  100 

=  . 125  *  LABR  if  non-cargo  aircraft 

100 

.828  .696 

PROG  =  2.19  EW  SP 

(.000)(.000) 


100 


.88  .29  102  32  CUR: UNDER 
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Table  17 

REPRESENTATIVE  SET:  EMPTY  WEIGHT  AND  CLIMB  RATE 


Estimating  Relationship 


2  Residual 

R  SEE  F  N  Pattern 


ENGR 

100 


TOOL 

100 


LABR 

100 


MATL 

100 


DS 


FT 


QC 

100 


.862  .485 


0100  EW  CLIMB 

(.000)(.000) 

.70 

.50 

34 

34 

CUR : UNDER 

.784  .238 

.227  EW  CLIMB 

( .000) ( .004) 

.75 

.39 

44 

32 

None 

.874  .168 

.383  EW  CLIMB 

( .000) ( .005) 

.87 

.29 

101 

32 

None 

.980  .303 

.345  EW  CLIMB 

(.000)(.001) 

.85 

.36 

85 

32 

CUR: UNDER 

.894  .553 

.0331  EW  CLIMB 

( . 000) ( . 002) 

.49 

.83 

14 

32 

CUR  .-UNDER 

.877  .571  .488  .491 

.0332  EW  CLIMB  AVAUW  TESTAC 

.71 

.56 

13 

27 

None 

(.000)(.000)  (.006)  (.049) 


.085  *  LABR  if  cargo  aircraft 
100 


PROG 

100 


.125  *  LABR  if  non-cargo  aircraft 
100 

.869  .308 

7.38  EW  CLIMB 
( .000) ( .000) 


.85  .32  82  32  CUR -.UNDER 
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Table  18 

REPRESENTATIVE  SET:  SINGLE  BEST  EQUATION  FOR  EACH  COST  ELEMENT 


2 

Residual 

|  Estimating  Relationship 

R 

SEE  F  N  Pattern 

-1 

.733  .925 

3.26  AUW  SPCLS 

(.000) (.000) 

.755  .570 

.0695  EW  SP 

(,000)(.001) 

.852  .379 

.198  EW  SP 

( . 000) ( . 002) 

.945  .752 

.0623  EW  SP 

(,000)(.000) 

.794  1.08 

10.5  EW  SPCLS 

(.000)(.000) 

.644  1.27  .767 

.00293  EW  SP  TESTAC 

( . 000) ( . 000) ( . 002 ) 

.085  *  LABR  if  cargo  aircraft 
100 

. 125  *  LABR  if  non-cargo  aircraft 
100 

.828  .696 

2.19  EW  SP 

(,000)(.000) 


,74  .46  42  32  CUR: UNDER 


78  .37  52  32  None 


.88  .28  109  32  None 


.85  .36  83  32  CUR: UNDER 


.54  .78  17  32  CUR: UNDER 


.74  .58  26  32  None 


.88  .29  102  32  CUR: UNDER 
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Since  there  is  little,  if  any,  advantage  to  mixing  the  set 
size/performance  variables,  the  recommended  equation  set  will  be  chosen 
from  among  the  four  sets  that  maintain  the  integrity  of  the  size/ 
performance  variable  combination.  Of  these  four  sets,  the  two  using 
speed  (AUW/SP  and  EW/SP)  have  slightly  better  statistical  properties 
than  the  two  sets  using  climb  rate.  Of  the  two  sets  using  speed,  the 
empty  weight/speed  set  (Table  16)  is  selected  as  the  "recommended"  set 
because  of  the  lower  standard  errors  of  estimate  with  respect  to  several 
of  the  cost  elements,  plus  the  fact  that  empty  weight  is  generally  a 
more  readily  available  input  than  airframe  unit  weight. 

The  estimating  relationships  in  the  recommended  equation  set  vary 
significantly  in  statistical  quality.  Although  none  of  the  seven  CERs 
reaches  our  standard  of  estimate  goal  of  0.18,  the  best  estimating 
relationships  are  generally  associated  with  the  largest  contributors  to 
total  cost: 


Cost  Element 

Percent  of  Total 
Cost  at  Q  =  100 

Standard  Error 
of  Estimate 

Engineering 

19 

.50 

Tooling 

16 

.37 

Manufacturing  labor 

34 

.28 

Manufacturing  material 

16 

.36 

Development  support 

5 

.80 

Flight  test 

6 

.58 

Quality  control 

4 

100 

ADDITIONAL  ANALYSIS 

As  stated  above,  the  engineering,  manufacturing  material, 
development  support,  flight  test,  and  total  program  cost  equations  tend 
to  underestimate  the  costs  of  the  most  recent  sample  aircraft.  We 
believe  this  difficulty  stems  from  the  combined  effects  of  numerous 
design-related  and  institutional  changes  that  have  occurred  over  the 
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1948-1978  time  period  (e.g.,  the  increased  emphasis  on  electronics  as 
well  as  changes  in  materials  of  construction,  manufacturing  processes, 
and  the  regulatory  framework).  Our  original  plan  was  to  develop 
specific  measures  that  would  reflect  these  changes.  Unfortunately,  this 
approach  did  not  prove  to  be  as  successful  as  we  would  have  liked.  For 
many  of  the  more  abstract  concepts  we  could  not  develop  unambiguous 
measures.  And  even  for  the  concepts  for  which  relatively  unambiguous 
measures  could  be  developed  and  tested,  the  results  were  marginal  at 
best.  Consequently,  two  alternative  approaches  were  investigated: 

1.  Deletion  of  older,  less  relevant  aircraft  from  the  sample;  and, 

2.  Incorporation  of  a  time  variable  into  those  equations 
exhibiting  the  underestimation  problem. 

Deletion  of  Older  Aircraft 

All  aircraft  with  first  flight  dates  before  1960  were  deleted  from 
the  sample.1  The  remaining  11  post-1960  aircraft  were  the  A-6,  A-7, 
A-10,  C-5 ,  C-141,  F-4,  F-lll ,  F-14,  F-15,  S-3,  and  T-39. 

A  comparison  of  a  few  of  the  key  variables  for  the  original  full 
sample  and  the  new  post-1960  sample  is  provided  in  Table  20.  Generally 
speaking,  the  post- 1960  sample  has  larger  means  and  standard  deviations. 

A  comparison  of  the  basic  32-aircraft  equation  set  and  an  analogous 
equation  set  based  only  on  the  11  post-1960  aircraft  is  provided  in 
Table  21.  As  indicated,  the  standard  errors  of  estimate  for  three  cost 
elements  decreased  somewhat  (tooling,  material,  and  flight  test)  and 
increased  somewhat  for  the  remainder  (engineering,  labor,  development 
support,  and  total  program  cost).  Additionally,  two  of  the  residual 
patterns  are  eliminated  but  three  remain. 

1The  choice  of  1960  as  a  breakpoint  is  not  intended  to  imply  a  hard 
and  fast  distinction  between  the  pre-1960  and  post-1960  aircraft. 

Rather,  it  more  correctly  represents  a  balance  between  eliminating 
older,  potentially  irrelevant  observations  on  the  one  hand,  and 
attempting  to  maintain  some  semblance  of  an  acceptable  sample  size  on 
the  other. 


96 


< A 

LU 


< 

> 


Ld 

_J 

CO 

< 

DC 

< 

> 


o 

CM 

0) 

-O 

to 


o 

'O 

ON 


I 


CO 

o 


Q- 


o 

z 

< 


-J 

< 


o 

c/5 


a: 

< 

Q- 

51 

O 

o 


lA  lA  O  4* 

o 

-O'  CO  o  +  o 

NO 

^OCOOOO 

O'  CD 

a\  O  O  lAO  M  o 

T*  — 

r^cup^coocNJNOco 

■  a 

CVJ  ro  |  f-  in  •  • 

CO 

p  E 

1  1  1  1  1  1  1 

1 

4/)  CO 

r*-  en  O  On  o  r-  lAO 

o  CO 

CVJ  lA  On  O0  Is-  r-  *— 

*— 

0- 

O  r—  vo  ro  cnj  o  • 

r-  ON  r-  J*  . 

lA  lA  + 

■?  CO  o  +  o 

0) 

«-*  o  o  o  o  o 

—  — 

On  O  CO  lA  O  C\J  -O' 

to  a. 

CM  O  CM  O  CM  00 

CO 

p  E 

CM  ro  CO  «-  lA  •  • 

CO 

O  to 

1-  CO 

1  1  l  1  1  1  1 

CM  O  O  J  O  NO  A, 

r-t-r-oO’-r- 

OJOM^O  • 
lAh-i*-  m  • 

1 

-O 

o 

NO 

on  0 

r-  oo  OO  vO  -J  CM 

r- 

r—  — - 

lA  CO  CM  O  On  NO  r- 

i  a 

NO  O  ro  J?  r-  o  • 

p  E 

O  CM  Os  o  • 

</>  to 
o  CO 
a. 

00  ON  CM 

0 

—  — 

On  vO  ia  O  On  00  r- 

oo 

<o  a 

VO  O  N»  CM  CM  lA  »- 

p  E 

SfO^f  fOr—  O  • 

O  cc 

CVJ  PO  NO  vo  * 

h-  CO 

lA  NO  »- 

o 

NO 

ON  0 

ro  lA  ON  r-  NO  —  O 

T-  - 

co  J*  CM  r-  *—  On  j- 

CM 

i  a 

r-  co  ^  ono  • 

P  E 

ONftJVO  00  • 

t/>  co 
o  CO 

Q_ 

-3-vO  r- 

0 

N  kA  i- 4*  (M  41  h* 

LA 

—  — 

ro  »-  on  ro  ^  ON  -O' 

r— 

co  Q. 

WOOONS'O 

P  E 

lA  iA  r-  • 

O  co 

m  -4  r- 

t-  co 

A 

</> 

P 

0 

-c  ^ 

X 

a>  p  c 

o 

—  -- 

■o 

0  n  e 

>  —  O’  \ 

*— ■  0>  P 

a 

p  — 

co 

—  p 

0 

cr  ro 

-O 

— 

3  ON  0  *-n  0 

-O 

—  c_  c  P 

<*- 

CO 

0  O  n  jc  n 

o 

■— 

E  >  —  c- 

co  *d 

CO 

>-  >iO!TJ£5  J 

0 

> 

■a 

i-  a  s)  —  <  < 

E 

—  E  o  a—  >  s 

3 

<u3wo<u 

Z 

-  97  - 
Table  21 


COMPARISON  OF  BASIC  32-AIRCRAFT  EQUATION  SET  TO  EQUATION  SET  BASED  ON 

SAMPLE  OF  11  POST-1960  AIRCRAFT 


Squat i on 

2 

R 

SEE 

F 

N 

Res i dua  l 
Pattern 

Part  A:  32-Aircraft 

Sample 

( from  Table 

16) 

ENGR 

100 

= 

.787  .980 

.00355  EW  SP 

(  .  000 ) ( . 000  ) 

.  70 

.50 

34 

32 

CUR  .-UNDER 

TOOL 

100 

= 

.755  .570 

.0695  EW  SP 

( . 000 ) ( . 000 ) 

.78 

.37 

52 

32 

None 

LABR 

100 

= 

.852  .379 

.198  EW  SP 

( . 000 ) ( . 002  ) 

.88 

.28 

109 

32 

None 

HATL 

100 

= 

.945  .752 

.0623  EW  SP 

( .000)( .000) 

.85 

.  36 

83 

32 

CUR: UNDER 

OS 

= 

.818  1.23 

.00417  EW  SP 

( .000)( .001 ) 

.52 

.80 

16 

32 

CUR: UNDER 

FT 

= 

.644  1.27  .767 

.00293  EW  SP  TESTAC 

( . 000 ) ( . 000 ) ( . 002 ) 

.74 

.58 

26 

32 

CUR: UNDER 

QC 

100 

= 

.085  *  LABR  if  cargo  aircraft 

100 

-- 

-- 

-- 

3 

-- 

X 

.125  *  LABR  if  non-cargo 

100 

a  i  rcraft 

-- 

— 

-- 

17 

-- 

PROG 

X 

. 828  . 696 

2. 19  EW  SP 

.88 

.29 

102 

32 

CUR: UNDER 

100 


( .000) ( .000) 


Part  B:  11  Poat-1960  Aircraft  • 

Tan  rT5T 


ENGR 

100 

=  .0133  EW  SP 

(  .001  )(  .030) 

.75 

.57 

12 

11 

CUR: UNOER 

TOOL 

100 

.778  .680 

=  .0221  EW  SP 

( .000)( .002) 

.93 

.26 

52 

11 

None 

• 

LABR 

100 

. 820  . 456 

*  .165  EW  SP 

( .000)( .018) 

.91 

.29 

42 

1 1 

None 

MATL 

100 

. 954  . 526 

=  .299  EW  SP 

<  .OOOX  .008) 

.94 

.27 

64 

11 

None 

OS 

.660  1.21 
=  .0323  EW  SP 

(  .026 )(  .033) 

.54 

.90 

5 

1 1 

CUR: UNDER 

• 

FT 

.336  .858  1.11 

=  .596  EW  SP  TESTAC 

(  .  038 )  (  . 040 ) ( . 020 ) 

.85 

.48 

14 

11 

None 

QC 

100 

*  .076  *  LABR  if  cargo  aircraft 

100 

-- 

— 

-- 

2 

-- 

• 

=  .126  *  LABR  if  non-cargo  aircraft 

100 

-- 

-- 

-- 

9 

-- 

.814  .676 

PROG  =  3.12  EW  SP  .88  .35  30  11  CUR: UNDER 

100  (.000) (.008) 
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Incorporation  of  Time  Variable 

The  second  approach  for  eliminating  time-dependent  residual 
patterns  is  to  introduce  a  time  variable  into  the  estimating 
relationship--in  this  case,  the  date  of  first  flight  measured  in  months 
since  January  1,  1940.  The  use  of  a  cumulative  time  variable  in  a  CER 
is  not  a  new  idea  (e.g.,  see  Ref.  3).  Such  measures  are  typically  used 
when  it  is  not  otherwise  possible  to  characterize  the  changes  in  cost 
that  have  occurred  over  time.  Invariably,  they  capture  the  combined 
effect  of  shifts  in  many  diverse  factors  including,  for  example:  the 
regulatory  framework;  aircraft  "quality"  (factors  not  directly  related 
to  speed  such  as  maneuvering  capability,  the  materials  of  construction, 
and  the  level  of  system  integration);  and  improvements  in  production 
technology  and  labor  productivity.  Consequently,  when  using  an  equation 
incorporating  a  time  variable  to  estimate  the  cost  of  a  future  aircraft, 
the  analyst  must  ensure  that  the  same  factors  will  be  operating  in  the 
future  as  operated  in  the  past  and  in  the  same  manner.  Clearly,  the 
opaque  nature  of  such  time  variables  makes  this  a  non-trivial  task. 

After  an  examination  of  the  relevant  full  sample  residual  plots, 
two  forms  of  the  first  flight  date  (FFD)  were  examined- -linear  and 
logarithmic.  Given  the  logarithmic  form  of  the  dependent  variable,  the 
linear  form  of  FFD  results  in  an  accelerating  rate  of  cost  increase 
(assuming  an  FFD  coefficient  greater  than  zero),  whereas  the  logarithmic 
form  of  FFD  results  in  a  decelerating  rate  of  cost  increase  (assuming  an 
FFD  exponent  of  less  than  one).  Unfortunately,  we  have  no  a  priori 
notions  with  respect  to  whether  the  rate  of  increase  is  rising  or 
falling. 

The  results  are  provided  in  Part  B  of  Tables  22  and  23.  As 
indicated,  the  residual  patterns  have  been  eliminated  in  each  of  the 
five  cost  elements  previously  exhibiting  such  a  pattern  (engineering, 
material,  development  support,  flight  test,  and  total  program  cost). 
Moreover,  the  standard  errors  of  estimate  have  been  reduced  in  each 
instance  where  the  time  variable  was  introduced.  Finally,  from  a 
statistical  standpoint,  it  should  be  noted  that  the  two  equation  sets 
incorporating  the  alternative  forms  of  first  flight  date  are  essentially 
equivalent . 
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Table  22 

COMPARISON  OF  BASIC  32-AIRCRAFT  EQUATION  SET  TO  ANALOGOUS  EQUATION  SET 
INCORPORATING  TIME  VARIABLE  (LINEAR  FORM) 


Equat ion 

2 

R 

SEE 

F 

N 

Res i dua  l 

Pa  tte rn 

Part  A: 

32-Aircraft  Sample  Without  Time  Vari 

able  ( f rom  Table 

16) 

ENGR  =  . 

100 

.787  .980 

00355  EW  SP 

( . 000 ) ( . 000 ) 

.  70  . 

50 

34 

32 

CUR: UNDER 

TOOL  =  . 

100 

.755  .570 

0695  EW  SP 

( . 000 ) ( .001  ) 

.  78 

37 

52 

32 

None 

LABR  =  . 

100 

.852  .379 

198  EW  SP 

( .000)( .002) 

.88 

28 

109 

32 

None 

MATL  =  . 

100 

.945  .752 

0623  EW  SP 

( . 000 l( ■ 000) 

.85 

36 

83 

32 

CUR: UNDER 

DS  =  . 

.818  1.23 

00417  EW  SP 

( ,000)( .001 ) 

.52  . 

80 

16 

32 

CUR :  UNDER 

FT  =  . 

.644  1.27  .767 

00293  EW  SP  (ESTAC 

(  . 000 ) ( . 000 ) ( . 002  ) 

.74 

58 

26 

32 

CUR: UNDER 

QC  =  . 

100 

085  *  LABR  ir  cargo  aircraft 

100 

-- 

-- 

-- 

3 

-* 

=  . 

125  "  LABR  if  non-cargo  aircraft 

100 

-- 

17 

PROG  *  c 

100 

.828  .696 

!.  19  EW  SP 

( . 000 ) ( . 000 ) 

.88 

29 

102 

32 

CUR: UNDER 

Part  B: 

32-A  ire  raft  Sample  with  Time  Variable  (Linear 

Form)  Added 

ENGR  =  . 

100 

.696  .829  .00421  x  FFD 

.00866  EW  SP  e 

( . 000 ) ( . 000 )  ( . 000 ) 

.84 

.  37 

51 

32 

None 

TOOL  =  , 

100 

.755  .570 

.0695  EW  SP 

( .OOOH  .001) 

.78 

.37 

52 

32 

None 

LABR  =  . 

100 

.852  .379 

,  198  EW  SP 

( . 000 ) ( . 002 ) 

.88 

.28 

109 

32 

None 

MATL  =  . 

100 

.888  .656  .00267  x  FFD 

.  1 1 1  EW  SP  e 

( . 000 ) ( . 000  )  ( . 000 ) 

.91 

.29 

90 

32 

None 

OS  *  . 

.739  1.10  .00365  x  FFD 

.00916  EW  SP  e 

(.000)(.001)  (.020) 

.59 

.75 

14 

32 

None 

FT  =  . 

.573  1.05  .915  .00322  x 

.00779  EW  SP  TESTAC  e 

( .000)  ( .000) ( .000)  (.007) 

FFD 

.79 

.52 

25 

32 

None 

QC  =  . 

100 

,085  *  LABR  if  cargo  aircraft 

100 

-- 

3 

=  . 

.125  *  LABR  if  non-cargo  aircraft 

100 

-- 

-- 

-- 

17 

-- 

.799  .647  .00136  x  FFD 

=  2.96  EW  SP  e 
100  (  .000)( .000)  ( .017) 


« 


« 


« 


PROG 


.89  .27  79  32  None 


100 


Table  23 

COMPARISON  OF  BASIC  32-AIRCRAFT  EQUATION  SET  TO  ANALOGOUS  EQUATION  SET 
INCORPORATING  TIME  VARIABLE  (LOGARITHMIC  FORM) 


Equation 

2 

R 

SEE 

F 

N 

Res i due  1 
Pattern 

Part 

;  A:  32-Aircraft  Sample  Without  Time  Variab 

le  (from  Table 

16) 

ENGR 

100 

.787  .980 

=  .00355  EW  SP 

( . 000 ) ( . 000 ) 

.70 

50 

34 

32 

CUR: UNDER 

TOOL 

100 

.755  .570 

=  .0695  EW  SP 

( ,000)( .001  ) 

.78 

37 

52 

32 

None 

LABR 

100 

.852  .379 

=  .  198  EW  SP 

(  .OOOX  .002) 

.88  . 

28 

109 

32 

None 

MATL 

100 

.945  .752 

=  .0623  EW  SP 

(.000 )( .000) 

.85 

36 

83 

32 

CUR: UNDER 

OS 

.818  1.23 

=  .00417  EW  SP 

( .000)( .001 ) 

.52  . 

80 

16 

32 

CUR: UNDER 

FT 

.644  1.27  .767 

=  .00293  EW  SP  TESTAC 

(  .OOOX  .OOOX  .002) 

.74  . 

58 

26 

32 

CUR: UNOER 

QC 

100 

*  .085  *  LABR  if  cargo  aircraft 

100 

-- 

-- 

3 

=  .125  *  LABR  if  non-cargo  aircraft 

100 

*• 

-- 

17 

PROG 

100 

.828  .696 

=  2. 19  EW  SP 

( . 000 ) ( . 000 ) 

.88 

29 

102 

32 

CUR: UNDER 

Part  B:  32-Aircraft  Sample  with  Time  Variable 

(Logarithmic  Form) 

Added 

1.02 


ENGR 

100 

= 

.000148  EW  SP  FFD 

(  .OOOX  .000)  (  .000) 

.84 

.36 

51 

32 

None 

TOOL 

100 

= 

.755  .570 

.0695  EW  SP 

(  .OOOX  .001) 

.78 

.37 

52 

32 

None 

LABR 

100 

= 

.852  .379 

.198  EW  SP 

( .OOOX  .002) 

.88 

.28 

109 

32 

None 

MATL 

100 

= 

.872  .627  .675 

.00772  EW  SP  FFO 

( . 000 ) ( . 000 )  ( . 000 ) 

.91 

.29 

95 

32 

None 

DS 

= 

.725  1.07  .863 

.000288  EW  SP  FFO 

(.OOOX. 002)  (.023) 

.59 

.76 

13 

32 

None 

FT 

= 

.546  .986  .944  .886 

.000263  EW  SP  TESTAC  FFD 

(  .OOOX  .001  )(  .000)  (.002) 

.80 

.50 

28 

32 

None 

QC 

100 

.085  *  LABR  if  cargo  aircraft 

100 

-- 

3 

= 

.125  *  LABR  if  non-cargo  aircraft 

100 

-- 

17 

-- 

PROG 

_ 

.790  .631  .350 

.747  EW  SP  FFO 

.90 

.27 

81 

32 

None 

100 


(  .OOOX  .000)(  .012) 
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Comparison  of  Alternative  Approaches 

Standard  Errors  of  Estimate.  As  shown  below,  the  results  with 
respect  to  the  comparison  of  standard  errors  of  estimate  are  mixed. 
Furthermore,  the  differences  are  small  and  hardly  a  basis  for  drawing 
any  conclusions. 


SEE(log) 

Cost  Element 

32 -Aircraft 
Sample  Without 
Time  Variable 

11-Aircraft 

Post-1960 

Sample 

32 -Aircraft 
Sample  With 
Linear  FFD 

32-Aircraft 
Sample  With 
Logarithmic 
FFD 

Engineering 

.50 

.57 

.37 

.36 

Tooling 

.37 

.26 

.37 

.37 

Manufacturing  labor 

.28 

.29 

.28 

.28 

Manufacturing  material 

.36 

.27 

.29 

.29 

Development  support 

.80 

.90 

.75 

.76 

Flight  test 

.58 

.48 

.52 

.50 

Total  program  cost 

.29 

.35 

.27 

.27 

Residual  Patterns 

As  indicated  below,  only  the  equation  sets 

incorporating  time  variables  are  completely  free 

of  residual 

patterns . 

Cost  Element  Equations 

Exhibiting  Tendency  to 

Underestimate  Most  Recent  Sample 

Aircraft 

32-Aircraft 

Basic 

11-Aircraft 

32-Aircraft 

Sample  With 

32-Aircraft 

Post-1960 

Sample  With 

Logarithmic 

Cost  Element 

Sample 

Sample 

Linear  FFD 

FFD 

Engineering  X 

Tooling 

Manufacturing  labor 
Manufacturing  material  X 

Development  support  X 

Flight  test  X 

Total  program  cost  X 


X 

X 

X 


< 


i 


« 


< 


« 


Accuracy  with  Respect  to  Post- 1960  Aircraft.  A  comparison  of  how 
well  each  of  the  four  equation  sets  estimates  the  11  post-1960  aircraft 
is  provided  in  Table  24.  On  the  basis  of  the  overall  average  of  the 
absolute  relative  deviations,  there  is  little  difference.  However, 
because  the  underestimates  are  generally  smaller  and  the  overestimates 
generally  larger,  it  seems  reasonable  to  suggest  that  the  time-modified 
equation  sets  will  usually  produce  higher  estimates  than  does  the 
equation  set  derived  from  the  basic  32-aircraft  sample. 

FINAL  SELECTION 

Difficulty  with  Sets  Incorporating  Time  Variable 

As  just  described,  he  introduction  of  a  time  variable  solves  the 
underestimation  problem  and  results  in  equations  with  relatively  good 
standard  errors  of  estimate.  Unfortunately,  there  is  one  major 
dif ficulty--we  are  unable  to  say  which  of  the  two  FFD  forms  more 
accurately  reflects  industry  experience.  The  statistical  analysis, 
which  included  an  examination  of  residuals,  indicated  that  the  two  sets 
were  virtually  equivalent  in  terms  of  explaining  the  variation  within 
the  database.  Nevertheless,  the  inability  to  distinguish  a  preferred 
variable  form  has  significant  implications  with  respect  to  estimating 
the  costs  of  future  aircraft.  As  illustrated  in  Fig.  11,  for  an 
aircraft  with  a  projected  first  flight  date  of  1995,  the  difference  in 
assumptions  (linear  FFD  compared  with  logarithmic  FFD)  leads  to  a 
difference  in  estimated  cost  of  over  50  percent.  Consequently,  because 
of  this  large  variation  in  projected  costs,  we  do  not  recommend  use  of 
either  equation  set  incorporating  the  time  variable.  Rather,  we  feel  it 
more  judicious  for  analysts  to  use  an  equation  set  without  a  time 
variable  and  to  explicitly  identify  potential  changes,  estimate  their 
likely  effect,  and  then  adjust  either  the  equations  or  resulting 
estimates  accordingly. 
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Table  24 

PERCENT  WHICH  ACTUAL  COST  EXCEEDS  (+)  OR  FALLS  SHORT  (-) 

OF  ESTIMATED  COST,  USING  ESTIMATES  OBTAINED  WITH  BASIC  32-AIRCRAFT 
EQUATION  SET  AND  ALTERNATIVE  SETS  INCORPORATING  TIME  DIMENSION 


Basic 

32- A  i  rc  ra  ft 
Sample 

1 1-Ai  rcraft 
Post-1960 
Samp  1  e 

32-Ai rcraft 
Samp  1 e  with 
Linear  FFD 

32-Ai rcraft 
Sample  wi th 
Loga  r i thm  i  c 
FFD 

Sum  of 

E I ements 

A-6 

+  12 

+  2 

+  8 

+  1 1 

A- 7 

-60 

-79 

-87 

-82 

A-  1 0 

+23 

+  14 

-  3 

-  7 

C-5 

+  8 

+  2 

+  1 

0 

C-141 

-54 

-65 

-60 

-58 

F-4 

+  2 

-  6 

+  2 

+  4 

F-1  1  1 

+  16 

+  9 

+  7 

+  7 

F  - 1  4 

-  5 

-13 

-24 

-28 

F-15 

+  5 

-  6 

-19 

-25 

T-39 

-19 

-33 

-30 

-26 

S-3 

+45 

±32 

+  30 

+  30 

Average  Absolute  Values 

23 

24 

25 

25 

Number  Underestimated  (  +  ) 

7 

5 

5 

4 

Number  Overestimated  (-) 

4 

6 

6 

6 

Tota I  Program  CER 


A-6 

♦  1 1 

+  3 

+  6 

+  8 

A-7 

-63 

-79 

-89 

-85 

A- 10 

+24 

+  16 

-  1 

-  3 

C-5 

+  7 

+  2 

0 

-  2 

C-141 

-58 

-69 

-66 

-65 

F-4 

-  1 

-  8 

-  2 

-  1 

F-111 

+  17 

+  12 

+  1  1 

+  10 

F-14 

-  6 

-12 

-20 

-23 

F-15 

+  9 

+  2 

-  7 

-10 

T-39 

-22 

-35 

-35 

-30 

S-3 

+45 

+40 

+  3 

+31 

Average  of  Absolute  Values 

24 

25 

24 

24 

Number  Underestimated  (+) 

6 

6 

3 

3 

Number  Overest i mated  (-) 

5 

5 

7 

8 

(based  on  sum  of  individual  elements) 
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Choosing  Between  the  Equation  Set  Based  on  the  32-Aircraft  Estimating 
Sample  and  that  Sample  Based  on  the  11  Post-1960  Aircraft  Sample 

We  recommend  the  equation  set  based  on  the  more  limited  post-1960 
sample  of  11  aircraft  (Part  B  of  Table  21)  for  the  following  reasons: 

1.  There  are  fewer  estimating  relationships  that  exhibit  a 
tendency  to  underestimate  the  most  recent  sample  aircraft;  and 

2.  Because  the  sample  comprises  relatively  recent  aircraft  with 
which  most  analysts  should  have  some  familiarity,  the  job  of 
adjusting  the  equations  or  resulting  estimates  should  be 
easier . 


XIII.  INCORPORATION  OF  F-16  AND  F-18 


After  completing  the  detailed  analysis  heretofore  described,  but 
before  the  publication  of  this  Note,  cost  data  on  the  F-16  and  F-18 
airframes  became  available.  Consequently,  a  brief  examination  was 
undertaken  to  determine  whether  inclusion  of  the  F-16  and  F-18  in  the 
database  would  dictate  modification  of  the  recommended  set  of  CERs 
(Table  21,  Part  B) .  This  examination  consisted  of  the  following  two 
steps : 

1.  Assessing  how  well  the  existing  equation  set  estimates  F-16  and 
F-18  costs;  and, 

2.  Assessing  the  stability  of  variable  coefficients  when  an 
analogous  equation  set  incorporating  the  F-16  and  F-18  is 
derived . 

ADJUSTMENT  OF  F-16  PRODUCTION  DATA 

Normally,  to  determine  the  cumulative  total  production  cost  for  the 
first  100  F-16  airframes,  we  would  take  recorded  data  for  the  two 
prototypes,  eight  FSD  aircraft,  and  the  first  90  aircraft  in  the  USAF 
FY77/78  buy  of  105  aircraft.  However,  because  of  the  concurrent 
multinational  coproduction  effort  (General  Dynamics  produces  all  of  the 
forward  fuselages  and  approximately  half  of  all  other  components),  the 
recurring  factory  labor  and  materials  cost  obtained  in  that  way  would  be 
understated  because  of  the  additional  learning  benefit  associated  with 
the  higher  overall  production.  Therefore,  the  production  labor  and 
material  costs  for  the  F-16  are  based  on  90  "equivalent"  aircraft.  The 
estimate  for  the  90  equivalent  aircraft  was  obtained  by  taking  the  costs 
for  the  first  90  production  units  of  each  component ,  plus  the 
integration  and  assembly  effort  for  the  first  90  aircraft,  and  then 
taking  their  sum. 


USING  THE  EXISTING  EQUATION  SET  TO  ESTIMATE  F-16  AND  F-18  COSTS 

A  comparison  of  F-16  and  F-18  actual  costs  to  estimated  costs  using 
the  CERs  provided  in  Table  21  (Part  B)  is  presented  in  Table  25 . 1  On 
the  basis  of  this  table,  the  following  observations  are  made: 

•  Although  the  relative  deviations  across  cost  elements  show  a 
fair  amount  of  uniformity  in  the  F-18  case,  the  same  cannot  be 
said  for  the  F-16,  where  values  range  from  roughly  +20  to  about 
-60. 

•  Especially  disturbing  is  the  fact  that  for  the  F-18,  the  two 
manufacturing  cost  elements  (labor  and  material)  that  account 
for  51  percent  of  total  airframe  cost  at  a  quantity  of  100  have 
fairly  large  deviations --namely,  +30  and  +50,  respectively. 

•  In  total,  the  full  estimating  sample  equation  set  overestimates 
F-16  costs  by  10  to  15  percent  and  underestimates  F-18  costs  by 
about  40  percent . 

The  fact  that  the  F-16  is  overestimated  and  the  F-18  underestimated 
is  not  all  that  surprising:  The  F-16  program  placed  a  great  deal  of 
emphasis  on  maintaining  cost  goals  and  the  F-18  program  faced  a 
particularly  involved  two-contractor  development.  Specific  reasons 
cited  for  the  F-16's  relatively  low  cost  and  the  F-18's  relatively  high 
cost  are  listed  below. 

F-16 

1.  Emphasis  on  simplicity2 

a.  Structural  materials  are  high  percentage  aluminum  (79 
percent)  and  very  low  percentage  steel,  titanium,  and 
composites  (11  percent) 

1More  precise  values  could  not  be  provided  because  of  proprietary 
restrictions . 

2List  of  examples  provided  by  Gordon  Fuqua  of  General  Dynamics, 

Fort  Worth  Division. 


COMPARISON  OF  F-I6  AND  F-I8  ESTIMATED  COSTS  WITH  ACTUALS:  RELATIVE  DEVIATIONS  (a) 
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b.  Extensive  use  of  standard  manufacturing  methods--60 
percent  of  parts  are  sheet  aluminum. 

c.  Used  a  fully  developed  engine  common  to  the  F-15. 

d.  Relatively  few  fastener  types  employed  (50  for  F-16 
compared  witn  250  for  F-lll). 

e.  Extensive  use  of  off-the-shelf  equipment  items  (257  out 
of  373  F-16  items  were  off  the  shelf;  almost  all  items 
on  the  B-58  and  F-lll  were  new). 

2.  Adherence  to  "design-to-cost"  philosophy:  No  major  design 
changes  were  introduced  by  the  Air  Force  or  General  Dynamics 
during  FSD  and  early  production;  in  fact,  the  first  group  of 
major  changes  to  the  F-16  did  not  occur  until  the  612th 
aircraft . 1 

3.  Relatively  high  production  rate  achieved  early  in  program 
(within  two  years  of  the  first  delivery,  General  Dynamics  had 
delivered  roughly  another  175  aircraft  and  the  Europeans 
another  SO).3 4 


F-18 

1.  Extensive  use  of  composites:  Roughly  11  percent  of  the  F-18 
structure  weight  is  composites,  far  higher  than  any  prior 
aircraft . 5 

2.  Carrier-based  F-18  is  actually  an  adaptation  of  land-based 
YF-17,  an  adaptation  that  was  complicated  by  the  fact  that  the 
original  design  was  done  by  Northrop  while  the  redesign  was 
primarily  the  responsibility  of  McDonnell.6 

3This  initial  set  of  modifications  is  known  as  Phase  1  of  the 
Multinational  Staged  Improvement  Program  or  Engineering  Change  Proposal 
350. 

4See  Ref.  5,  p.  100. 

sNote,  however,  that  the  AV-8B,  which  was  also  developed  by 
McDonnell  Douglas  and  in  roughly  the  same  timeframe  as  the  F-18,  has 
approximately  25  percent  of  its  structure  weight  in  composites. 

s"0n  January  22,  1976,  the  U.S.  Navy  gave  McDonnell  Douglas  the 
go-ahead  to  develop  the  carrier-based  F-18.  Northrop,  the  company  that 
conceived  the  basic  design  of  the  F-18  as  the  F-17,  became  an  associate 
contractor,  assigned  40  percent  of  airframe  development  and  airframe 
production"  (see  Ref.  6,  p.  164). 

It  has  also  been  suggested  that  F-18  costs  could  be  expected  to  be 
higher  than  the  norm  because  the  aircraft  was  designed  to  satisfy  both 
fighter  and  attack  missions.  However,  in  retrospect  we  do  not  feel  that 
this  was  a  major  contributor  to  the  F-18's  relatively  high  cost,  because  the 
fighter  and  attack  configurations  turned  out  to  be  so  similar  (in  the 
attack  version,  a  FLIR  and  laser  tracker  replace  fuselage-mounted  Sparrow 
missiles ) . 
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1 
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3.  Difficulty  in  Northrop/McDonnell  relationship  (at  one  point, 
the  two  firms  were  engaged  in  a  court  battle). 

4.  Relatively  slow  production  rate  buildup:  FSD  (11  aircraft)  was 
followed  by  pilot  production  (9  aircraft)  and  limited 
production  (25  aircraft)  before  initial  full-scale  production 
(60  aircraft). 

ASSESSING  THE  STABILITY  OF  VARIABLE  COEFFICIENTS 

A  comparison  of  the  existing  equation  set  (from  Table  21,  Part  B) 
with  an  analogous  equation  set  that  includes  the  F-16  and  F-18  is 
presented  in  Table  26.  Overall,  a  one-to-one  pairing  of  variable 
exponents  indicates  that  the  updated  equation  set  places  a  little  less 
emphasis  on  weight  and  a  little  more  emphasis  on  speed--what  one  might 
expect  as  a  result  of  adding  two  relatively  small,  fast  aircraft  to  the 
estimating  sample.  However,  in  general,  the  changes  in  equation 
coefficients  are  relatively  minor.  Furthermore,  it  should  also  be  noted 
that  based  on  Cook's  Distance,  neither  the  F-16  nor  the  F-18  is 
indicated  to  be  an  influential  observation. 

CHOOSING  BETWEEN  THE  EXISTING  (32-AIRCRAFT)  AND 
MODIFIED  (34-AIRCRAFT)  EQUATION  SETS 

We  conclude  that  from  a  statistical  standpoint,  inclusion  of  the 

F-16  and  F-18  in  the  estimating  sample  makes  little  difference. 

However,  since  most  users  would  prefer  to  use  an  equation  set  that  was 

based  on  the  most  up-to-date  information,  the  modified  equation  set 

(Part  B  of  Table  26)  is  selected  as  the  recommended  set. 


COMPARISON  OF  ALL-MISSION  TYPE  EQUATION  SETS  WITH  AND  WITHOUT  F-16  AND 


XIV.  CONCLUDING  REMARKS 


RECOMMENDED  EQUATION  SET 

The  equation  set  that  we  recommend  is  presented  in  Table  27.  It  is 
based  on  an  estimating  sample  of  13  post-1960  aircraft  (four  attack 
aircraft,  two  bombers  and  transports,  six  fighters,  and  one  trainer). 

The  ranges  of  the  variables  used  in  the  derivation  of  the  set  are  as 
follows : 

Characteristic  Data  Base  Range 

Empty  weight  (lb)  9,753  -  320,085 

Maximum  speed  (kn)  389  -  1250+ 

Number  of  flight  test  aircraft  10  -  33 

The  estimating  relationships  in  the  recommended  equation  set  vary 
significantly  in  statistical  quality.  Four  of  the  CERs  have  standard 
errors  of  estimate  of  about  0.30,  whereas  the  other  three  have  standard 
errors  of  estimate  about  0.50  or  greater.  None  of  the  equations  meets 
our  standard  error  of  estimate  goal  of  0.18.  On  the  other  hand,  the 
lowest  standard  errors  of  estimate  in  the  set  are  associated  with  cost 
elements  (tooling,  labor,  and  material),  which  typically  account  for  67 
percent  of  total  program  cost  (at  a  quantity  of  100;  at  a  quantity  of 
200,  these  elements  account  for  73  percent  of  total  program  cost). 
Finally,  we  note  that  there  is  some  tendency  for  the  engineering, 
development  support,  and  total  program  cost  equations  to  underestimate 
the  costs  of  the  most  recent  sample  aircraft. 

CONSTRUCTION/PROGRAM  VARIABLES 

With  respect  to  the  incorporation  of  variables  describing  program 
characteristics  and  airframe  construction  characteristics,  we  conclude 
that  such  variables  are  of  no  help  in  improving  the  overall  quality  of 
the  equation  sets.  Although  variables  characterizing  the  level  of 
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Table  27 

RECOMMENDED  SET  OF  CERS  (a) 


Equation 

R2 

SEE 

F 

N 

ENGR 

100 

.777  .894 

=  .0103  EW  SP 

(.000)  (.010) 

.72 

.55 

13 

13 

TOOL 

100 

.777  .696 

=  .0201  EW  SP 

(.000)  (.000) 

.92 

.25 

56 

13 

LABR 

100 

.820  .484 

=  .141  EW  SP 

(.000)  (.013) 

.88 

.31 

38 

13 

MATL 

100 

.921  .621 

=  .241  EW  SP 

(.000)  (.003) 

.91 

.30 

51 

13 

DS 

.630  1.30 

=  .0251  EW  SP 

(.016)  (.012) 

.54 

.82 

6 

13 

FT 

.325  .822  1.21 

=  .687  EW  SP  TESTAC 

(.032)  (.037)  (.010) 

.83 

.48 

15 

13 

QC 

100 

=  .076  x  LABR  if  cargo  aircraft 

100 

-- 

-- 

-- 

2 

=  . 133  x  LABR  if  non-cargo  aircraft 

100 

-- 

-- 

-- 

11 

PROG 

100 

.798  .736 

=  2.57  EW  SP 

(.000)  (.003) 

.85 

.36 

29 

13 

(a)Repeated  from  Table  26,  Part  B. 


system  integration  were  frequently  found  to  be  statistically 
significant,  they  did  not,  as  a  rule,  result  in  any  substantial 
improvement  in  the  quality  of  the  equations.  In  most  cases,  the 


equations  incorporating  such  variables  did  not  produce  results  that  we 
viewed  as  credible.  Moreover,  even  in  those  few  instances  where  the 
equations  did  produce  credible  results,  the  reduction  in  the  standard 
error  of  estimate  was  never  more  than  two  or  three  percentage  points. 

COMPARISON  TO  DAPCA  III 

Now  that  a  new  set  of  CERs  has  been  determined  for  the  full 
estimating  sample,  the  inevitable  question  becomes:  How  does  the  new 
set  differ  from  the  prior  set  (DAPCA  III)?  In  this  subsection,  we 
attempt  to  answer  this  question  by  comparing  the  current  recommended  set 
of  estimating  relationships  (Table  27)  to  the  DAPCA  III  estimating 
relationships  (Table  28)  on  the  basis  of:  (a)  standard  errors  of 
estimate,  and  (b)  predictive  capability.  Before  proceeding,  however,  we 
make  note  of  a  number  of  factors  that  complicate  this  comparison. 

1.  Different  Samples.  The  sample  used  to  derive  the  current 
recommended  set  has  added  the  F-101,  F-15,  F-16,  F-18,  S-3,  and 
A-10  to  the  estimating  sample.  Additionally,  several  older 
fighters  (the  F3D,  F-86,  and  F-89),  which  had  been  dropped  from 
the  DAPCA  III  estimating  sample,  were  reintroduced.1 

2.  Different  Measures  of  Airframe  Size.  The  current  recommended 
set  uses  empty  weight  as  the  size  variable,  whereas  DAPCA  III 
uses  airframe  unit  weight. 

3  Different  Types  of  Initial  Coefficient  Estimates.  The  current 
recommended  set  provides  mean  estimates  of  the  initial 
coefficient,  whereas  DAPCA  III  provides  median  estimates.7 

lThey  were  reintroduced  to  bolster  the  size  of  the  fighter 
subsample . 

7As  discussed  in  Sec.  Ill,  if  cost  is  estimated  in  a  log-linear 

form,  then  the  factor  for  adjusting  a  median  estimate  to  a  mean  estimate 

,  SEEz/2 
is  given  by  e  . 


Table  28 

DAPCA  Ml  ESTIMATING  RELAT  I ONSH  I  PS(  a  ) 
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Standard  Errors  of  Estimate 

As  shown  in  Table  29,  the  results  with  respect  to  the  comparison  of 
standard  errors  of  estimate  are  mixed.  When  compared  to  DAPCA  III,  the 
current  set  has  lower  standard  errors  of  estimate  for  the  tooling, 
labor,  and  material  elements  (which  account  for  66  percent  of  total  cost 
at  a  quantity  of  100)  and  higher  standard  errors  of  estimate  for  the 
engineering,  development  support,  and  flight  test  cost  elements  (which 
account  for  30  percent  of  total  cost  at  a  quantity  of  100). 

Relative  Accuracy 

A  comparison  of  how  well  the  current  equation  set  and  the  DAPCA  III 
equation  set  estimate  the  13  post-1960  aircraft  is  provided  in  Table  30. 
Judging  by  the  overall  average  of  the  absolute  relative  deviations, 
there  is  little  difference.  However,  the  current  equation  set 
underestimates  fewer  aircraft  than  does  DAPCA  III. 


Table  29 

COMPARISON  OF  STANDARD  ERRORS  OF  ESTIMATE 


Standard  Error  of 


Cost  Element 

Percent  of  Total 
Cost  at  Q  =  100 

Estimates 

DAPCA  III 

dog) 

Current 

Engineering 

19 

.26 

.55 

Tooling 

16 

.41 

.25 

Manufacturing  labor 

34 

.34 

.31 

Manufacturing  material 

16 

.36 

.30 

Development  support 

5 

•72(b)) 

.82 

•  66(c) f 

Flight  test 

6 

.44 

.48 

96(a) 

(a) Quality  control  is  other  4%. 

(b) Labor  component  of  development  support. 

(c) Material  component  of  development  support. 
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Table  30 

PERCENT  BY  WHICH  ACTUAL  COST  EXCEEDS  (  +  )  OR  FALLS  SHORT  (-) 
OF  ESTIMATED  COST,  USING  ESTIMATES  OBTAINED 
WITH  DAPCA  III  AND  CURRENT  EQUATION  SETS 


Aircraft 

Sum  of  Elements 

Total  Program  CER 

DAPCA  III 

Current 

DAPCA  III 

Current 

A-6 

+  11 

0 

+  10 

0 

A-7 

-81 

-86 

-86 

-85 

A-10 

+  15 

+13 

+17 

+  15 

C-5 

+  12 

+  4 

+  14 

+  5 

C- 141 

-43 

-64 

-46 

-67 

F-4 

+  7 

-14 

+  2 

-16 

F-lll 

+  17 

+  2 

+  16 

+  7 

F- 14 

-  7 

-22 

-11 

-20 

F- 15 

+  9 

-15 

+  6 

-  5 

F*  16 

-  8 

-23 

-13 

o 

CM 

1 

F- 18 

+36 

+33 

+34 

+36 

T-39 

-36 

-37 

-40 

-39 

S-3 

+44 

+  39 

+45 

+40 

Average  of  absolute  values 

25 

27 

26 

27 

Number  underestimated  (+) 

8 

5 

8 

5 

Number  overestimated  (-) 

5 

7 

5 

7 

Level  of  Estimates 

An  indication  of  how  much  the  estimates  produced  by  the  current 
equation  set  exceed  (or  fall  short)  of  those  produced  by  DAPCA  III  is 
provided  in  Table  31.  As  there  are  only  two  negative  numbars  in  the 
table,  and  both  of  those  are  small,  it  is  reasonable  to  suggest  that  the 
current  equation  set  will  produce  estimates  that  are  greater  than  or 
equal  to  those  produced  by  DAPCA  III. 

COST-QUANTITY  SLOPES 

Minimum,  maximum,  and  average  cost -quant ity  slopes  for  the  full 
estimating  sample  are  provided  in  Table  33.  A  comparison  of  slopes  by 
mission  type  is  provided  in  Table  32.  With  two  exceptions  (the  attack 
aircraft  material  slope  and  the  fighter  quality  control  slope),  the 


Table  31 


I 


COMPARISON  OF  RELATIVE  LEVELS  OF  ESTIMATES  OBTAINED 
USING  DAPCA  III  AND  CURRENT  EQUATION  SETS 


I 


I 


I 


> 


> 
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Characteristics 

Percent  by  Which 
Estimate  Exceeds 
Short  (-)  of  DAPCA 

Current  Set 
(+)  or  Falls 
III  Estimate 

Airframe 

Unit 

Empty 

Total 

Weight 

Weight  Speed 

Sum  of 

Program 

Aircraft  (lb) 

(lb)  (kn) 

Elements 

CER 

A-6 

17,150 

25,298 

561 

+  13 

+  11 

A-7 

11,621 

15,497 

595 

+  2 

0 

A-10 

14,842 

19,856 

389 

+  2 

+  1 

C-5 

279,145 

320,085 

495 

+  9 

+  10 

C-141 

104,322 

136,900 

491 

+  15 

+  15 

F-4 

17,220 

27,530 

1222 

+  23 

+  18 

F-  111 

33,150 

46,170 

1262 

+  17 

+  11 

F- 14 

26,500 

36,825 

* 

+  14 

+  4 

F-15 

17,550 

26,795 

J. 

+26 

+  14 

F-16 

9,565 

14,062 

-T- 

+  14 

+  6 

F- 18 

20,583 

.y 

+  5 

-  3 

T-39 

7,027 

9,753 

468 

+  1 

-  1 

S-3 

18,536 

26,581 

429 

+  10 

+  9 

*1000+ 

(actual  value  class: 

if ied)  . 

Table  32 

CUMULATIVE  TOTAL  COST-QUANTITY  SLOPES 

Engineering 

Hours 

Tooling 

Hours 

Mfg. 

Labor 

Hours 

Mfg. 

Material 

Cost 

Quality 

Control 

Hours 

Total 

Program 

Cost 

Number  of 

observations 

34 

34 

34 

34 

22 

34 

Range  (%) 

106-132 

108-158 

140-182 

140-200 

126-234 

124-144 

Average  (%) 

114 

122 

154 

172 

158 

134 

Exponent 

.  189 

.287 

.623 

.  782 

660 

.422 

NOTES:  Results  are  based  on  first  200  units;  cumulative  average 
slope  =  cumulative  total  slope  divided  by  two. 
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Table  33 


CUMULATIVE 

TOTAL  COST-QUANTITY 

SLOPES 

(%)  BY  MISSION  TYPE 

■ 

Mfg. 

Mfg. 

Quality 

Total 

Engineering 

Tooling 

Labor 

Material 

Control 

Program 

Sample 

Hours 

Hours 

Hours 

Cost 

Hours 

Cost 

Total 

114 

122 

154 

172 

158 

134 

Attack 

110 

122 

154 

180 

154 

134 

Bomber/ transport 

116 

116 

154 

170 

152 

136 

F ighter 

116 

124 

156 

172 

170 

132 

• 

slopes  show  little  deviation 

about  the 

full  s 

ample  averages.  However, 

even  changes  in  slope  as  small  as  1  percentage  point  can  have  a  major 
effect  on  cost.  The  extent  of  this  effect  will  of  course  vary  with  the 
quantity  and  the  slope  magnitude,  but  for  a  run  of  700  aircraft,  a  1 
percentage  point  increase  in  the  slope  will  usually  increase  total  costs 
by  at  least  10  percent. 

Since  the  estimating  relationships  in  the  recommended  equation  set 
(Table  27)  are  based  on  a  sample  limited  to  post-1960  aircraft,  average 
cumulative  total  slopes  for  the  post-1960  sample  are  also  determined  and 
then  compared  to  the  full  sample: 


Cost  Element 


Post-1960  Sample 

Full  _ 

Sample  Slope  Exponent 


Engineering 

1 14°o 

112% 

.  163 

Tooling 

122 

120 

.263 

Manufacturing  labor 

154 

156 

.641 

Manufacturing  material 

172 

174 

.  799 

Quality  control 

158 

156 

.641 

Total  program  cost 

134 

132 

.401 

120 


As  indicated,  the  differences  are  slight  and  hardly  a  basis  for  drawing 
any  conclusions.  However,  in  the  interest  of  consistency,  the  slopes 
based  on  the  post- 1960  sample  are  suggested  for  use  with  the  recommended 
equation  set. 


FULLY  BURDENED  LABOR  RATES 

All  cost  elements  estimated  directly  in  dollars  are  in  1977 
dollars.  Suggested  1977  fully  burdened,  hourly  labor  rates  (and  those 
used  to  estimate  total  program  cost)  are: 


Engineering 

27 

50 

Tooling 

25 

50 

Manufacturing  labor 

23 

50 

Quality  control 

24 

00 

For  estimates  in  1986  dollars,  the  following  hourly  labor  rates  and 
adjustment  factors  are  suggested: 


Engineering  59.10 
Tooling  60.70 
Manufacturing  labor  50.10 
Quality  control  55.40 
Manufacturing  material  (index)  1.94 
Development  support  (index)  1.94 
Flight  test  (index)  1.94 
Total  program  (index)  2.13 


The  1986  labor  rates  are  based  on  data  provided  by  seven  contractors: 


l 
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Labor  Category 

Hourly  Rates  ($) 

Range  About 
Average  (%) 

Average 

Range 

Engineering 

59.10 

47.70-70.00 

-19,  +18 

Tooling 

60.70 

56.50-65.00 

-  7,  +  7 

Manufacturing  labor 

50.10 

41.70-58.00 

-17,  +16 

Quality  control 

55.40 

49.10-62.60 

-11,  +13 

Note  that  with  the  exception  of  tooling,  the  range  about  the  average 
rate  is  at  least  +  or  -10  percent.  Such  differences  could  arise  from 
differences  in  accounting  practices,  business  bases,  and  capital 
investment.  Irrespective  of  cause,  however,  labor  rate  variation  is  one 
more  component  of  a  larger  uncertaintv  that  already  includes  the  error 
associated  with  statistically  derived  estimating  relationships  and 
questions  about  the  proper  cost-quantity  slope.  Furthermore,  in 
addition  to  the  inter-contractor  differences,  these  rates  are  also 
subject  to  temporal  change--accounting  procedures,  relative 
capital/labor  ratio,  etc.  Thus,  the  1986  fully  burdened  rate  is 
qualitatively  different  than  the  1977  rate.  Unfortunately,  trying  to 
estimate  the  magnitude  of  such  quality  changes,  even  very  crudely,  is  a 
study  in  itself  and  beyond  the  scope  of  this  analysis. 

The  material,  development  support,  and  flight  test  escalation 
indexes  are  based  on  data  provided  in  AFR  173-13. 1  For  the  years 
1977-1984,  the  airframe  index  presented  in  Table  5-3  ("Historical 
Aircraft  Component  Inflation  Indices")  was  used.  For  the  years  1985  and 
1986,  the  aircraft  and  missile  procurement  index  presented  in  Table  5-2 
("USAF  Weighted  Inflation  Indices  Based  on  OSD  Raw  Inflation  and  Outlay 
Rates")  was  used.  The  total  program  cost  adjustment  factor  was  then 
determined  on  the  basis  of  a  weighted  average  (at  q  =  100)  of  the 
individual  cost  elements. 


3 See  Ref.  7. 
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Appendix  A 

USE  OF  MISSION  DUMMY  VARIABLES 


As  stated  in  the  Introduction,  one  of  the  purposes  of  this  study  is 
to  examine  the  utility  of  dividing  the  estimating  sample  into  subsample 
representing  the  major  mission  types  (attack  aircraft,  fighters  and 
bomber/transport  aircraft).  This  is  to  be  done  by  analyzing  each 
subsample  separately.  However,  an  alternative  approach  to  this  issue 
would  assign  yes/no-type  dummy  variables  for  each  mission  type  and  use 
the  full  sample.  Thus,  each  dummy  mission  variable  would  take  on  a 
value  of  one  for  aircraft  in  its  class  and  zero  for  other  aircraft. 
Additionally,  each  could  be  applied  to  either  the  equation  intercept  or 
to  the  equation  slope.  The  effect  of  each  application  is  illustrated  in 
Fig.  A. 1 . 


8  9  10  11  12  13  8  9  10  11  12  13 

Logarithm  of  empty  weight  Logarithm  of  empty  weight 


(a)  Intercept  (b)  Slope 


Fig.  A.  1— Effect  of  mission  dummy  variables 
on  slope  and  intercept 
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Since  this  was  a  supplemental  effort,  the  analysis  was  limited  to 
the  following  three  equation  forms : 

Application  Explanatory  Variables 

Intercept  Empty  weight 

Slope  Empty  weight 

Intercept  Empty  weight  and  speed 

Intuitively,  it  was  felt  that  for  a  given  weight,  fighters  would  be 
the  most  costly  mission  type,  followed  by  attack  aircraft,  and  then 
bombers  and  transports.  Thus,  bombers  and  transports  were  assumed  to  be 
the  baseline  and  consequently  only  two  mission  dummy  variables  were 
required  for  the  regression  analysis--the  fighter  designator  (F)  and  the 
attack  aircraft  designator  (A).  Furthermore,  the  variable  significance 
level  was  dropped  to  10  percent.  Thus,  if  a  mission  dummy  variable  was 
not  significant  at  the  10  percent  level,  it  was  deleted  from  the 
analysis  and  the  estimating  relationship  redetermined.  Consequently,  in 
some  instances,  the  estimating  relationship  collapsed  into  a  form 
without  any  mission  designators. 

The  estimating  relationships  meeting  our  initial  screening 
criterion  relative  to  variable  significance  are  summarized  in  Tables 
A.l,  A. 2,  and  A. 3.  Overall,  the  results  were  disappointing--the 
equations  had  difficulties  associated  with  residual  patterns,  exponent 
magnitude,  and  counterintuitive  reversals  of  our  a  priori  rank  ordering 
of  mission-type  costs.  Consequently,  the  use  of  mission  dummy  variables 
to  stratify  the  full  estimating  sample  was  not  pursued  beyond  that  which 
is  documented  in  this  appendix. 


MISSION  DUMMY  VARIABLES:  INTERCEPT/EMPTY  WEIGHT 


MISSION  DUMMY  VARIABLES:  SLOPE/EMPTY  WEIGHT 
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Appendix  B 

CORRELATION  MATRIXES 

This  appendix  contains  correlation  matrixes  for  the  full  estimating 
sample  (32  aircrft) . 1  Table  B.l  provides  Pearson  correlation 
coefficients  for  all  possible  pairwise  combinations  of  dependent  and 
independent  variables.  Table  B.2  provides  coefficients  for  all  possible 
pairwise  combinations  of  independent  variables. 

1These  correlation  coefficients  were  used  in  conjunction  with  the 
work  completed  before  the  incorporation  of  the  F-16  and  F-18. 
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Table  B.l 

CORRELATION  MATRIX:  COST  VARIABLES  WITH  POTENTIAL 
EXPLANATORY  VARIABLES 


EXPLANATORY 

VAP/ABLES 


8/ZE 

Jn  AUW 
Jn  Eh/ 

Jn  WTAPEA 
PER  POP  M A  NCE 


Jn  SP 
Jn  SPCLS 
Jn  CL /MB 
Jn  US  ELD 
CONSTPOCT/ON 


Jn  ULTLD 
Jn  CAPPDV 
Jn  ENGLOC 
Jn  WGTYPE 
Jn  iMGh/ET 
Jn  Eh/AUiN 
Jn  AYAOW 
Jn  BLBOX 
PROGRAM 


Jn  TESTAC 
Jn  TOOL  CP 
Jn  ENGDY 
Jn  EXPDY 
Jn  PPGDY 


Jn. 

ENGR 

JUt 

TOOL 

Jn 

LA  BP 

0.69 

0.79 

0.90 

0.70 

0.83 

0.92 

0.60 

077 

0.85 

0.32 

O./S 

002 

0.40 

0./9 

0.05 

0.20 

- 0.03 

-0./4 

0.37 

0.40 

0.44 

• 0.39 

•0.6/ 

•0.62 

• 0./4 

-027 

• 0./4 

0.25 

0.45 

0.49 

0.30 

0.32 

0./2 

-o./s 

- 0.07 

-0./7 

• 0.30 

•O./S 

•0.33 

•0.2/ 

-0.2/ 

-0.29 

0.77 

0.58 

0.67 

0.22 

0.29 

0.06 

-O.SO 

- 0.42 

•0.6/ 

0.24 

0.24 

0.28 

o.// 

- 0.06 

-O.OS 

•0.60 

-0.4/ 

-0.48 

COST  YAP/ABLES 


0.84 

0.86 

0.79 

0./7 
0.22 
• 0.03 

0.44 

-O  57 
-0./7 
044 
0.27 
•0./2 
- OS V 
•0.3/ 
0.76 

0./0 
- 0.58 
0./8 
•0.0/ 
•O.S/ 


J~ 

ELTTST 


0.53 

0.56 

0.42 

0.34 

0.39 

0.20 

0.24 

■ 0.23 
-0./9 
O.  // 
0.43 
- 0.02 
-o.os 
0.08 
0.6/ 

0.45 
- 0.32 
0./4 
0.03 
- 0.69 


0.60 
0.6 / 
0.45 
0.20 

•O.// 
•0.06 
- 0.04 
0.62 
0./3 
0.25 
O./O 
0.45 

0.59 

•  O./S 
0/2 

•  0.05 
•O.SS 


0.84 

0.86 

0.77 

0.20 

0.24 

0.02 

0.4/ 

•0.56 
-0./9 
0.4/ 
0.29 
- 0./4 
-0.26 
-0.22 
0.72 

0.22 
-0.55 
0.26 
000 
- 0.56 
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